00010000:00010000:0.0F:1788639292.724848:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1788639293.112833:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773086592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639293.112916:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1788639293.113011:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773086592 00000100:00100000:2.0:1788639293.113024:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773086592 00000100:00100000:2.0:1788639293.113081:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788639293.113090:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773086592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639293.113121:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788639293.122740:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773086592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9641us (9814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639293.122754:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788639293.123061:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773086592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639293.415233:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639293.415313:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754139904 00000100:00100000:2.0:1788639293.415325:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754139904 00000100:00100000:2.0:1788639293.415397:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 166 00000100:00100000:2.0:1788639293.415408:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:2405:x1875523754139904:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639293.415527:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:2405:x1875523754139904:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 120us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639293.415536:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 166 00000100:00100000:2.0:1788639293.428096:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639293.428146:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639293.428183:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639293.428202:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639293.428219:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639293.428248:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639293.428266:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639293.428292:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639293.428322:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754140032 00000100:00100000:0.0:1788639293.428415:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754140544 00000100:00100000:0.0:1788639293.428426:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754140544 00000100:00100000:0.0:1788639293.428500:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754140160 00000100:00100000:0.0:1788639293.428504:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754140160 00000100:00100000:0.0:1788639293.428538:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754140672 00000100:00100000:0.0:1788639293.428541:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754140672 00000100:00100000:0.0:1788639293.428558:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:0.0:1788639293.428568:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+6:2405:x1875523754140544:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639293.428680:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+6:2405:x1875523754140544:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 113us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639293.428688:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:0.0:1788639293.428705:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:0.0:1788639293.428710:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+5:2405:x1875523754140160:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639293.428757:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+5:2405:x1875523754140160:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 46us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639293.428764:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:0.0:1788639293.428775:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:0.0:1788639293.428780:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+5:2405:x1875523754140672:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639293.428797:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+5:2405:x1875523754140672:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 17us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639293.428803:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:0.0:1788639293.428824:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754140288 00000100:00100000:0.0:1788639293.428828:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754140288 00000100:00100000:0.0:1788639293.428845:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754140800 00000100:00100000:0.0:1788639293.428847:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754140800 00000100:00100000:0.0:1788639293.428856:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754140416 00000100:00100000:0.0:1788639293.428864:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754140416 00000100:00100000:0.0:1788639293.428877:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754140928 00000100:00100000:0.0:1788639293.428878:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754140928 00000100:00100000:0.0:1788639293.428890:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:0.0:1788639293.428895:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f164030-9448-43be-b8f2-64db35b5d669+5:2405:x1875523754140288:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639293.428919:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f164030-9448-43be-b8f2-64db35b5d669+5:2405:x1875523754140288:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 24us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639293.428925:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:0.0:1788639293.428934:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:0.0:1788639293.428939:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64907637-38d0-4ad4-9e99-06074f162345+5:2405:x1875523754140800:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639293.428955:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64907637-38d0-4ad4-9e99-06074f162345+5:2405:x1875523754140800:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 16us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639293.428961:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:0.0:1788639293.428968:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:0.0:1788639293.428973:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f164030-9448-43be-b8f2-64db35b5d669+5:2405:x1875523754140416:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639293.428989:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f164030-9448-43be-b8f2-64db35b5d669+5:2405:x1875523754140416:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 16us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639293.428995:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:0.0:1788639293.429002:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:0.0:1788639293.429007:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64907637-38d0-4ad4-9e99-06074f162345+5:2405:x1875523754140928:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639293.429037:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64907637-38d0-4ad4-9e99-06074f162345+5:2405:x1875523754140928:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 29us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639293.429043:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00080000:0.0:1788639293.429058:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639293.429067:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639293.429070:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788639293.429072:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639293.430375:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754140032 00000100:00100000:2.0:1788639293.430445:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:2.0:1788639293.430454:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+22:2405:x1875523754140032:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639293.430539:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+22:2405:x1875523754140032:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 86us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639293.430554:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00080000:0.0:1788639293.431610:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788639293.749439:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639294.704078:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639294.704153:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754141056 00000100:00100000:0.0:1788639294.704167:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754141056 00000100:00100000:0.0:1788639294.704243:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:0.0:1788639294.704256:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+22:15612:x1875523754141056:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788639294.704412:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+22:15612:x1875523754141056:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 Request processed in 148us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639294.704420:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:1.0:1788639294.714530:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639294.714991:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754141184 00000100:00100000:2.0:1788639294.715005:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754141184 00000100:00100000:2.0:1788639294.715319:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00100000:2.0:1788639294.715332:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+5:15612:x1875523754141184:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788639294.715474:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+5:15612:x1875523754141184:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 Request processed in 145us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639294.715483:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00100000:0.0:1788639294.735780:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639294.738047:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754141440 00000100:00100000:1.0:1788639294.738068:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754141440 00000100:00100000:1.0:1788639294.738158:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:1.0:1788639294.738171:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f164030-9448-43be-b8f2-64db35b5d669+22:15612:x1875523754141440:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788639294.738519:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f164030-9448-43be-b8f2-64db35b5d669+23:15612:x1875523754141440:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 338us (2741us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788639294.738527:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 12 00000001:00080000:3.0F:1788639294.745324:0:17221:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:3.0:1788639294.745376:0:17221:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae36a011a80 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:3.0:1788639294.745383:0:17221:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae242ff4c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae343e85600 00000020:00080000:3.0:1788639294.745387:0:17221:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae242ff4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae241669e00 00000020:00080000:2.0:1788639294.745426:0:17278:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00010000:00010000:0.0:1788639294.745516:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639294.745530:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788639294.745538:0:17278:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788639294.745539:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639294.745549:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639294.745555:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639294.745565:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639294.745588:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:0.0:1788639294.745591:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639294.745604:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639294.745611:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639294.773051:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639295.157038:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788639295.157068:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773086720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639295.157165:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639295.157983:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773086720 00000100:00100000:0.0:1788639295.157996:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773086720 00000100:00100000:0.0:1788639295.158079:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639295.158093:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773086720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639295.158133:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788639295.158213:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773086720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639295.158222:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639295.158286:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773086720:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788639295.158366:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639295.669018:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773086848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639295.669119:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639295.669227:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773086848 00000100:00100000:1.0:1788639295.669237:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773086848 00000100:00100000:1.0:1788639295.669303:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788639295.669315:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773086848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639295.669360:0:17981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788639295.670414:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773086848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1095us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639295.670426:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788639295.670451:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773086848:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788639295.796896:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639296.181402:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788639296.181433:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773086976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639296.181538:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639296.181780:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773086976 00000100:00100000:2.0:1788639296.181790:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773086976 00000100:00100000:2.0:1788639296.181858:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788639296.181869:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773086976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639296.181917:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788639296.181983:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773086976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639296.181990:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788639296.182079:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773086976:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788639296.823439:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639297.205247:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773087104:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205321:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639297.205365:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773087616:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205388:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639297.205404:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773088128:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639297.205441:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773088640:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639297.205483:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788639297.205489:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773087488:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639297.205539:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773088000:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205557:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639297.205573:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523773088512:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205591:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639297.205639:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773087616 00000100:00100000:3.0:1788639297.205646:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773087616 00000100:00100000:3.0:1788639297.205677:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773088128 00000100:00100000:3.0:1788639297.205679:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773088128 00000100:00100000:3.0:1788639297.205688:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773088640 00000100:00100000:3.0:1788639297.205689:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773088640 00000100:00100000:3.0:1788639297.205705:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773088512 00000100:00100000:3.0:1788639297.205707:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773088512 00000100:00100000:3.0:1788639297.205730:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788639297.205736:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773087616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205779:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773087616:12345-0@lo:400:kworker.0 Request processed in 42us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639297.205785:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788639297.205799:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788639297.205803:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773088128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205823:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773088128:12345-0@lo:400:kworker.0 Request processed in 20us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639297.205828:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788639297.205836:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788639297.205841:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773088640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205859:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773088640:12345-0@lo:400:kworker.0 Request processed in 18us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639297.205864:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788639297.205871:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788639297.205876:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523773088512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205894:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523773088512:12345-0@lo:400:kworker.0 Request processed in 18us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639297.205899:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788639297.205915:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773087488 00000100:00100000:3.0:1788639297.205918:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773087488 00000100:00100000:3.0:1788639297.205937:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773088000 00000100:00100000:3.0:1788639297.205939:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773088000 00000100:00100000:3.0:1788639297.205954:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788639297.205959:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773087488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.205991:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773087488:12345-0@lo:400:kworker.0 Request processed in 32us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639297.205997:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788639297.206006:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788639297.206011:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773088000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.206969:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773088000:12345-0@lo:400:kworker.0 Request processed in 954us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639297.206978:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788639297.207005:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639297.207009:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639297.207011:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639297.207323:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773087104 00000100:00100000:0.0:1788639297.207330:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773087104 00000100:00100000:0.0:1788639297.207367:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788639297.207374:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:3642:x1875523773087104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.207421:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:3642:x1875523773087104:12345-0@lo:400:kworker.0 Request processed in 48us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639297.207428:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788639297.207471:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773087360:0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.207519:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639297.207544:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773087872:0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.207563:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639297.207579:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773088384:0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.207599:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639297.207635:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788639297.207642:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773087232:0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.207666:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639297.207684:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773087744:0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.207703:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639297.207717:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523773088256:0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.207735:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639297.207751:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae374871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773088768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639297.207786:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639297.207814:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773087232 00000100:00100000:0.0:1788639297.207819:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773087232 00000100:00100000:0.0:1788639297.207841:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773087744 00000100:00100000:0.0:1788639297.207844:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773087744 00000100:00100000:0.0:1788639297.207975:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788639297.207981:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773087232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.208019:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773087232:12345-0@lo:400:kworker.0 Request processed in 38us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639297.208038:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788639297.208051:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788639297.208056:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773087744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.208092:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773087744:12345-0@lo:400:kworker.0 Request processed in 36us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639297.208098:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788639297.208125:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773087360 00000100:00100000:0.0:1788639297.208128:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773087360 00000100:00100000:0.0:1788639297.208156:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773087872 00000100:00100000:0.0:1788639297.208159:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773087872 00000100:00100000:0.0:1788639297.208176:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788639297.208181:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773087360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.208214:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773087360:12345-0@lo:400:kworker.0 Request processed in 33us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639297.208220:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788639297.208230:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788639297.208236:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773087872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.208261:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773087872:12345-0@lo:400:kworker.0 Request processed in 25us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639297.208267:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788639297.208288:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773088384 00000100:00100000:0.0:1788639297.208292:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773088384 00000100:00100000:0.0:1788639297.208314:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773088256 00000100:00100000:0.0:1788639297.208316:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773088256 00000100:00100000:0.0:1788639297.208330:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788639297.208336:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773088384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.208364:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773088384:12345-0@lo:400:kworker.0 Request processed in 28us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639297.208369:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788639297.208380:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788639297.208394:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523773088256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.208420:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523773088256:12345-0@lo:400:kworker.0 Request processed in 28us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639297.208425:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788639297.208670:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773087232:0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.208681:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773087744:0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.208691:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523773088256:0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.208699:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773087360:0@lo:400:kworker.0 00000100:00100000:0.0:1788639297.208708:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773087872:0@lo:400:kworker.0 00010000:00080000:0.0:1788639297.208718:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae244036300 x1875523773088384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639297.208728:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773088384:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.209178:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773087488:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.209191:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773088000:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.209201:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523773088512:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.209209:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773087104:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.209220:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773087616:0@lo:400:kworker.0 00000100:00100000:3.0:1788639297.209230:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773088128:0@lo:400:kworker.0 00010000:00080000:3.0:1788639297.209239:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae244034a80 x1875523773088640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639297.209248:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773088640:0@lo:400:kworker.0 00000100:00080000:3.0:1788639297.209276:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639297.209280:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639297.209283:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639297.210269:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773088768 00000100:00100000:2.0:1788639297.210278:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773088768 00000100:00100000:2.0:1788639297.210331:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788639297.210339:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773088768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639297.210367:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788639297.210460:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773088768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639297.210467:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788639297.210546:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae374871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773088768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639297.210833:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639297.210844:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773088896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639297.211025:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639297.211097:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773088896 00000100:00100000:2.0:1788639297.211110:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773088896 00000100:00100000:2.0:1788639297.211131:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788639297.211137:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773088896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639297.211149:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788639297.211187:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773088896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639297.211193:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788639297.211311:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773088896:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788639297.761935:0:20616:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 16:14:57 (1788639297) 00010000:00010000:3.0:1788639297.847478:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639298.228862:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639298.228891:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773089024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639298.228949:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639298.229083:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773089024 00000100:00100000:0.0:1788639298.229090:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773089024 00000100:00100000:0.0:1788639298.229134:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788639298.229141:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773089024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788639298.229166:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788639298.229211:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773089024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639298.229218:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788639298.229307:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773089024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639298.534138:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639298.534173:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639298.534197:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639298.534224:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639298.534254:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754141824 00000100:00100000:1.0:1788639298.534262:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754141824 00000100:00100000:1.0:1788639298.534312:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754141696 00000100:00100000:1.0:1788639298.534315:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754141696 00000100:00100000:1.0:1788639298.534337:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 70 00000100:00100000:1.0:1788639298.534347:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+5:2405:x1875523754141824:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639298.534413:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+5:2405:x1875523754141824:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 68us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639298.534421:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 70 00000100:00100000:1.0:1788639298.534436:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 71 00000100:00100000:1.0:1788639298.534443:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+13:2405:x1875523754141696:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639298.534471:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+13:2405:x1875523754141696:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 29us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639298.534477:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 71 00000100:00100000:1.0:1788639298.534512:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754141952 00000100:00100000:1.0:1788639298.534516:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754141952 00000100:00100000:1.0:1788639298.534545:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:1.0:1788639298.534552:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f164030-9448-43be-b8f2-64db35b5d669+5:2405:x1875523754141952:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639298.534577:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f164030-9448-43be-b8f2-64db35b5d669+5:2405:x1875523754141952:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639298.534583:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00080000:1.0:1788639298.534609:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788639298.534637:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788639298.534640:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639298.535032:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754141568 00000100:00100000:0.0:1788639298.535037:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754141568 00000100:00100000:0.0:1788639298.535081:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 168 00000100:00100000:0.0:1788639298.535089:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:2405:x1875523754141568:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639298.535514:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:2405:x1875523754141568:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 424us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639298.535522:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 168 00000100:00100000:1.0:1788639298.541572:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639298.541630:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639298.541672:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639298.541701:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639298.541729:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639298.541763:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754142208 00000100:00100000:1.0:1788639298.541773:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754142208 00000100:00100000:0.0:1788639298.543064:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754142080 00000100:00100000:0.0:1788639298.543073:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754142080 00000100:00080000:2.0:1788639298.543140:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639298.543140:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754142464 00000100:00100000:0.0:1788639298.543145:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754142464 00000100:00100000:0.0:1788639298.543190:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754142592 00000100:00080000:2.0:1788639298.543192:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639298.543194:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754142592 00000100:00100000:0.0:1788639298.543231:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:0.0:1788639298.543241:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+5:2404:x1875523754142080:12345-192.168.206.18@tcp:9:kworker.0 00000020:00000080:0.0:1788639298.543267:0:18750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d799 00000100:00080000:0.0:1788639298.543282:0:18750:0:(import.c:65:import_set_state_nolock()) ffff9ae36d088000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788639298.543343:0:18750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:2.0:1788639298.543372:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639298.543516:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+2:2404:x1875523754142080:12345-192.168.206.18@tcp:9:kworker.0 Request processed in 276us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639298.543524:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:0.0:1788639298.543542:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:0.0:1788639298.543549:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64907637-38d0-4ad4-9e99-06074f162345+5:2404:x1875523754142464:12345-192.168.206.18@tcp:9:kworker.0 00000020:00000080:0.0:1788639298.543562:0:18750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d7d8 00000100:00080000:0.0:1788639298.543570:0:18750:0:(import.c:65:import_set_state_nolock()) ffff9ae242d30800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788639298.543595:0:18750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788639298.543679:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64907637-38d0-4ad4-9e99-06074f162345+2:2404:x1875523754142464:12345-192.168.206.18@tcp:9:kworker.0 Request processed in 131us (2007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639298.543685:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:0.0:1788639298.543698:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:0.0:1788639298.543713:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64907637-38d0-4ad4-9e99-06074f162345+5:2404:x1875523754142592:12345-192.168.206.18@tcp:9:kworker.0 00000020:00000080:0.0:1788639298.543726:0:18750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d7d1 00000100:00080000:0.0:1788639298.543731:0:18750:0:(import.c:65:import_set_state_nolock()) ffff9ae374823800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788639298.543754:0:18750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788639298.543805:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64907637-38d0-4ad4-9e99-06074f162345+2:2404:x1875523754142592:12345-192.168.206.18@tcp:9:kworker.0 Request processed in 94us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639298.543811:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 35 00010000:00010000:0.0:1788639298.543868:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639298.543873:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639298.543877:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639298.543901:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754142336 00000100:00100000:0.0:1788639298.543905:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754142336 00000100:00100000:0.0:1788639298.543936:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 72 00000100:00100000:0.0:1788639298.543943:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64907637-38d0-4ad4-9e99-06074f162345+5:2405:x1875523754142336:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639298.543970:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64907637-38d0-4ad4-9e99-06074f162345+5:2405:x1875523754142336:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 27us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639298.543976:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 72 00000100:00100000:1.0:1788639298.544226:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 73 00000100:00100000:1.0:1788639298.544235:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+6:2405:x1875523754142208:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639298.544267:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+6:2405:x1875523754142208:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 34us (2653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639298.544274:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 73 00000100:00080000:2.0:1788639298.546547:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788639298.546556:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788639298.868710:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788639299.509212:0:17279:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788639299.509221:0:17279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788639299.509250:0:17279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788639299.509257:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788639299.892783:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639300.277573:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773089152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639300.277664:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639300.277769:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773089152 00000100:00100000:0.0:1788639300.277776:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773089152 00000100:00100000:0.0:1788639300.277834:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788639300.277845:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773089152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639300.277871:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788639300.277917:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773089152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639300.277924:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788639300.278020:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639300.278144:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773089152:0@lo:13:osp-pre-0-1.0 00000020:00080000:0.0:1788639300.280270:0:17221:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:2.0:1788639300.280374:0:17278:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:2.0:1788639300.280389:0:17278:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000100:00100000:2.0:1788639300.786031:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639300.786813:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754142848 00000100:00100000:3.0:1788639300.786827:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754142848 00000100:00100000:3.0:1788639300.786930:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:3.0:1788639300.786945:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f164030-9448-43be-b8f2-64db35b5d669+13:16372:x1875523754142848:12345-192.168.206.18@tcp:35:umount.0 00000001:00080000:3.0:1788639300.787244:0:17244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788639300.787366:0:17244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00080000:2.0:1788639300.787823:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639300.788440:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f164030-9448-43be-b8f2-64db35b5d669+16:16372:x1875523754142848:12345-192.168.206.18@tcp:35:umount.0 Request processed in 1492us (2415us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1788639300.788452:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00000020:00080000:3.0:1788639300.788459:0:17244:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788639300.792769:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639300.792800:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773089280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639300.792950:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639300.793144:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773089280 00000100:00100000:2.0:1788639300.793174:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773089280 00000100:00100000:2.0:1788639300.793244:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788639300.793256:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773089280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639300.793299:0:17981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788639300.793361:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773089280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639300.793368:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788639300.793428:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773089280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639300.802583:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639300.803698:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754142976 00000100:00100000:3.0:1788639300.803718:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754142976 00000100:00100000:2.0:1788639300.804049:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639300.804309:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639300.804714:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754143232 00000100:00100000:3.0:1788639300.804722:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754143232 00000100:00100000:3.0:1788639300.804760:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:3.0:1788639300.804771:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+14:2407:x1875523754142976:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639300.804801:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639300.804826:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef5400/0x25c454990262d76f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85875 expref: 14 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639300.804851:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639300.804921:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:2407:x1875523754142976:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 152us (2354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639300.804930:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:3.0:1788639300.804950:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:3.0:1788639300.804957:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3820c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:2407:x1875523754143232:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639300.804966:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639300.804987:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae37f78a600/0x25c454990262d833 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8595c expref: 12 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639300.805007:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639300.805028:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3820c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:2407:x1875523754143232:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 72us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639300.805034:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:2.0:1788639300.807864:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639300.808009:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754143104 00000100:00100000:3.0:1788639300.808023:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754143104 00000100:00100000:3.0:1788639300.808105:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:3.0:1788639300.808115:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:2407:x1875523754143104:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639300.808133:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639300.808170:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef4c00/0x25c454990262d776 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858a6 expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639300.808192:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639300.808269:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:2407:x1875523754143104:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 155us (3960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639300.808277:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:0.0:1788639300.809719:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754143360 00000100:00100000:0.0:1788639300.809733:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754143360 00000100:00100000:0.0:1788639300.810236:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:0.0:1788639300.810250:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+5:2404:x1875523754143360:12345-192.168.206.18@tcp:9:umount.0 00000020:00000080:0.0:1788639300.810311:0:18750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d792 00000100:00080000:0.0:1788639300.810829:0:18750:0:(import.c:65:import_set_state_nolock()) ffff9ae242d36000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788639300.810901:0:18750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788639300.811566:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+2:2404:x1875523754143360:12345-192.168.206.18@tcp:9:umount.0 Request processed in 1154us (3548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639300.811579:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 36 00010000:00010000:0.0:1788639300.811660:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639300.812099:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639300.821484:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639300.821589:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754144256 00000100:00100000:0.0:1788639300.821603:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754144256 00000100:00100000:0.0:1788639300.821720:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:0.0:1788639300.821732:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+16:2404:x1875523754144256:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:0.0:1788639300.821778:0:17240:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d784 00000020:00010000:0.0:1788639300.821810:0:17240:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae369170000: total 0 00000100:00080000:0.0:1788639300.821816:0:17240:0:(import.c:65:import_set_state_nolock()) ffff9ae369174800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788639300.821854:0:17240:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1788639300.822066:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+15:2404:x1875523754144256:12345-192.168.206.18@tcp:39:umount.0 Request processed in 336us (608us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1788639300.822075:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 67 00000020:00010000:2.0:1788639300.822385:0:17230:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae369170000: total 0 00010000:00010000:2.0:1788639300.822468:0:17230:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae369170000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788639300.822525:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:2.0:1788639300.822529:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788639300.822540:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859cc expref: 14 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639300.822560:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:2.0:1788639300.822564:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788639300.822568:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fa00/0x25c454990262da9b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a19 expref: 13 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639300.822584:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae242375500) 00010000:00010000:2.0:1788639300.822586:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639300.822590:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262d86b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8596a expref: 12 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639300.822677:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242376b00) 00010000:00010000:2.0:1788639300.822680:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788639300.822685:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d8aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85978 expref: 11 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639300.822698:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:2.0:1788639300.822701:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788639300.822705:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da39 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859f6 expref: 10 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639300.822721:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639300.822724:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788639300.822728:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23a00/0x25c454990262d84f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85963 expref: 9 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639300.822743:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:2.0:1788639300.822745:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788639300.822749:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262d92f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a2 expref: 8 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639300.822763:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:2.0:1788639300.822766:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788639300.822770:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262d9de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859e1 expref: 7 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639300.822784:0:17230:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae369170000, canceled 8 locks, left on hash table 0. 00010000:00010000:2.0:1788639300.822810:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639300.822818:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639300.822820:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639300.834761:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639300.835005:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754144384 00000100:00100000:1.0:1788639300.835018:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754144384 00000100:00080000:3.0:1788639300.835187:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639300.835516:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:1.0:1788639300.835532:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+5:2404:x1875523754144384:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:1.0:1788639300.835574:0:17242:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d78b 00000100:00080000:1.0:1788639300.835597:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9ae369175000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788639300.835676:0:17242:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788639300.835990:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+3:2404:x1875523754144384:12345-192.168.206.18@tcp:39:umount.0 Request processed in 462us (1242us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788639300.835999:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 68 00010000:00010000:0.0:1788639300.836536:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639300.922304:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639301.301566:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639301.301599:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3505d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773089408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639301.301747:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639301.302014:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773089408 00000100:00100000:1.0:1788639301.302025:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773089408 00000100:00100000:1.0:1788639301.302113:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788639301.302125:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773089408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639301.302173:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788639301.302257:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773089408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639301.302269:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788639301.302327:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3505d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773089408:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788639301.941092:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788639302.005484:0:17999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788639302.325485:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773089536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639302.325741:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639302.326102:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773089536 00000100:00100000:2.0:1788639302.326112:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773089536 00000100:00100000:2.0:1788639302.326199:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788639302.326214:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773089536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639302.326252:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788639302.327045:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639302.327069:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3505d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773089664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639302.327141:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.327526:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773090176:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.327565:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.327588:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773090688:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.327612:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.327686:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788639302.327692:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773090048:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.327717:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.327737:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773090560:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.327771:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.327791:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773091072:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.327814:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.327845:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773090176 00000100:00100000:1.0:1788639302.327852:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773090176 00000100:00100000:1.0:1788639302.327892:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773090688 00000100:00100000:1.0:1788639302.327902:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773090688 00000100:00100000:1.0:1788639302.327928:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773090560 00000100:00100000:1.0:1788639302.327931:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773090560 00000100:00100000:1.0:1788639302.327940:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773091072 00000100:00100000:1.0:1788639302.327942:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773091072 00000100:00100000:1.0:1788639302.327957:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788639302.327965:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773090176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328020:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773090176:12345-0@lo:400:kworker.0 Request processed in 54us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.328027:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788639302.328047:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788639302.328054:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773090688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328081:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773090688:12345-0@lo:400:kworker.0 Request processed in 28us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.328087:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788639302.328098:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788639302.328104:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773090560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328129:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773090560:12345-0@lo:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.328135:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788639302.328145:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788639302.328151:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773091072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328177:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773091072:12345-0@lo:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.328183:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788639302.328205:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788639302.328209:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639302.328229:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773089792:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328264:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.328290:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773090304:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328308:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.328320:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773090816:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328332:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.328343:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788639302.328347:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773089920:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328359:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.328375:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773090432:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328396:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.328413:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773090944:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328433:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639302.328459:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773089792 00000100:00100000:1.0:1788639302.328463:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773089792 00000100:00100000:1.0:1788639302.328510:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788639302.328517:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+24:3643:x1875523773089792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328551:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+24:3643:x1875523773089792:12345-0@lo:400:kworker.0 Request processed in 35us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.328557:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788639302.328591:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773090816 00000100:00100000:1.0:1788639302.328595:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773090816 00000100:00100000:1.0:1788639302.328646:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773090944 00000100:00100000:1.0:1788639302.328650:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773090944 00000100:00100000:1.0:1788639302.328665:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788639302.328670:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773090816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328705:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773090816:12345-0@lo:400:kworker.0 Request processed in 36us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.328711:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788639302.328721:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788639302.328726:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773090944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328747:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773090944:12345-0@lo:400:kworker.0 Request processed in 22us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.328753:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788639302.328764:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788639302.328767:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639302.328774:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773090304 00000100:00100000:1.0:1788639302.328777:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773090304 00000100:00100000:1.0:1788639302.328800:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773089920 00000100:00100000:1.0:1788639302.328803:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773089920 00000100:00100000:1.0:1788639302.328815:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788639302.328820:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773090304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328852:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773090304:12345-0@lo:400:kworker.0 Request processed in 32us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.328858:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788639302.328869:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788639302.328875:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773089920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328901:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773089920:12345-0@lo:400:kworker.0 Request processed in 26us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.328907:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788639302.328953:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773089920:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328964:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773090944:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328980:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773089792:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.328989:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773090304:0@lo:400:kworker.0 00010000:00080000:1.0:1788639302.329000:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375c48700 x1875523773090816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639302.329012:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773090816:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.329051:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773090560:0@lo:400:kworker.0 00010000:00080000:1.0:1788639302.329064:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375c4ad80 x1875523773091072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639302.329072:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773091072:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.329083:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773090176:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.329094:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773090688:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.329172:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773090048 00000100:00100000:1.0:1788639302.329176:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773090048 00000100:00100000:1.0:1788639302.329210:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773090432 00000100:00100000:1.0:1788639302.329214:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773090432 00000100:00100000:1.0:1788639302.329234:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788639302.329240:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773090048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.329294:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773090048:12345-0@lo:400:kworker.0 Request processed in 54us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.329301:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788639302.329312:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788639302.329318:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773090432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.329359:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773090432:12345-0@lo:400:kworker.0 Request processed in 42us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.329366:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788639302.329389:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639302.329407:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773090432:0@lo:400:kworker.0 00000100:00100000:1.0:1788639302.329431:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773090048:0@lo:400:kworker.0 00000100:00100000:3.0:1788639302.330590:0:18751:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788639302.330607:0:18751:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788639302.330804:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773089664 00000100:00100000:3.0:1788639302.330814:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773089664 00000100:00080000:3.0:1788639302.330865:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788639302.330953:0:20726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788639302.330964:0:20726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773089664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788639302.330989:0:20726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788639302.331073:0:20726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773089664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (3931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639302.331079:0:20726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788639302.331130:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3505d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773089664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639302.331443:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773089536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5233us (5701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639302.331452:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788639302.332683:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773089536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639302.484015:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639302.484743:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754144512 00000100:00100000:1.0:1788639302.484760:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754144512 00000100:00100000:1.0:1788639302.484872:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:1.0:1788639302.484886:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:2408:x1875523754144512:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639302.484906:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639302.484935:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fac00/0x25c454990262d7ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858e5 expref: 10 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639302.484959:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639302.485329:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+9:2408:x1875523754144512:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 444us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.485338:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:3.0:1788639302.485781:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639302.488230:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754144768 00000100:00100000:1.0:1788639302.488250:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754144768 00000100:00100000:1.0:1788639302.488347:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:1.0:1788639302.488358:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+9:2405:x1875523754144768:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639302.488379:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639302.488404:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fa600/0x25c454990262d7b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85916 expref: 9 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639302.488452:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639302.488551:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:2405:x1875523754144768:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 193us (2771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.488560:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:3.0:1788639302.489611:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639302.489727:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754144640 00000100:00100000:1.0:1788639302.489735:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754144640 00000100:00100000:1.0:1788639302.489786:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:1.0:1788639302.489796:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:2408:x1875523754144640:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639302.489810:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639302.489829:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fb000/0x25c454990262d82c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85955 expref: 8 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639302.489844:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639302.489884:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+7:2408:x1875523754144640:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 90us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639302.489891:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:2.0:1788639302.496351:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639302.499914:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754145024 00000100:00100000:1.0:1788639302.499940:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754145024 00000100:00100000:1.0:1788639302.500065:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 69 00000100:00100000:1.0:1788639302.500079:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+6:2404:x1875523754145024:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:1.0:1788639302.500136:0:18565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d7c3 00000020:00010000:1.0:1788639302.500146:0:18565:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae36d08f000: total 0 00000100:00080000:1.0:1788639302.500153:0:18565:0:(import.c:65:import_set_state_nolock()) ffff9ae36d08d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788639302.500181:0:18565:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:1.0:1788639302.500371:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+5:2404:x1875523754145024:12345-192.168.206.18@tcp:39:umount.0 Request processed in 295us (4036us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788639302.500399:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 69 00000100:00080000:3.0:1788639302.501145:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788639302.506876:0:18396:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae36d08f000: total 0 00010000:00010000:0.0:1788639302.506980:0:18396:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae36d08f000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788639302.507032:0:18396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242376b00) 00010000:00010000:0.0:1788639302.507036:0:18396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788639302.507052:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc000/0x25c454990262d8b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8597f expref: 4 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639302.507082:0:18396:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae36d08f000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788639302.507095:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639302.507097:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639302.507099:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639302.518829:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639302.519662:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754145152 00000100:00100000:1.0:1788639302.519677:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754145152 00000100:00100000:1.0:1788639302.519777:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 70 00000100:00100000:1.0:1788639302.519791:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+5:2404:x1875523754145152:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:1.0:1788639302.519851:0:17242:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d7ca 00000100:00080000:1.0:1788639302.519864:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9ae3461e3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788639302.519939:0:17242:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788639302.520110:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+3:2404:x1875523754145152:12345-192.168.206.18@tcp:39:umount.0 Request processed in 321us (1294us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788639302.520118:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 70 00010000:00010000:2.0:1788639302.520204:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639302.520657:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639302.561957:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639302.562142:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754145408 00000100:00100000:2.0:1788639302.562156:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754145408 00000100:00100000:2.0:1788639302.562238:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 170 00000100:00100000:2.0:1788639302.562250:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+7:2404:x1875523754145408:12345-192.168.206.18@tcp:251:umount.0 00000020:00000080:2.0:1788639302.562308:0:17236:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d761 00000020:00010000:2.0:1788639302.562318:0:17236:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae36d08b800: total 0 00000100:00080000:2.0:1788639302.562324:0:17236:0:(import.c:65:import_set_state_nolock()) ffff9ae36d08c000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788639302.562422:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+3:2404:x1875523754145408:12345-192.168.206.18@tcp:251:umount.0 Request processed in 174us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639302.562431:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 170 00000020:00010000:0.0:1788639302.562663:0:17230:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae36d08b800: total 0 00010000:00010000:0.0:1788639302.562668:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639302.562739:0:17230:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae36d08b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788639302.562784:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fbe00/0x25c454990262d768 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8586e expref: 2 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639302.562812:0:17230:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae36d08b800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788639302.562825:0:17230:0:(genops.c:885:class_export_put()) final put ffff9ae36d08b800/275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3 00010000:00010000:0.0:1788639302.562846:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639302.562849:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639302.562851:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788639302.565900:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d08b800/275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3 for MGS 00000020:00000080:1.0:1788639302.565986:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae36d08c000 for MGS 00010000:00010000:0.0:1788639302.965830:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639303.351305:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773091200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639303.351424:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639303.351746:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773091200 00000100:00100000:0.0:1788639303.351770:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773091200 00000100:00100000:0.0:1788639303.352101:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788639303.352114:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773091200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788639303.352151:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788639303.352222:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773091200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639303.352231:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788639303.352310:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773091200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788639303.990215:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788639304.236210:0:20812:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788639304.250037:0:20812:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788639304.250096:0:20812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.250110:0:20812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.250118:0:20812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.250125:0:20812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.250148:0:20812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788639304.250163:0:20812:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788639304.250191:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788639304.250196:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788639304.250201:0:20812:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788639304.250224:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ae3506eb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788639304.250342:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773091328:0@lo:39:umount.0 00000100:00100000:3.0:1788639304.250401:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639304.250489:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773091328 00000100:00100000:1.0:1788639304.250496:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773091328 00000100:00100000:1.0:1788639304.250791:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788639304.250803:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875523773091328:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788639304.250830:0:18565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d355 00000100:00080000:1.0:1788639304.250838:0:18565:0:(import.c:65:import_set_state_nolock()) ffff9ae3490b0800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788639304.250910:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1875523773091328:12345-0@lo:39:umount.0 Request processed in 108us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639304.250917:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1788639304.250927:0:18565:0:(genops.c:885:class_export_put()) final put ffff9ae3490b5800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788639304.250974:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639304.250982:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639304.250990:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639304.250992:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639304.250997:0:18396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.251007:0:18396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639304.251015:0:18396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639304.251022:0:18396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788639304.251024:0:18396:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788639304.251027:0:18396:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788639304.251053:0:18396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.251060:0:18396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1788639304.251074:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3490b5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1788639304.251081:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.251090:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.251104:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639304.251106:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639304.251108:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639304.251121:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773091456:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788639304.251129:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae3490b0800 for lustre-MDT0000 00000100:00100000:2.0:1788639304.251168:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788639304.251695:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae3506eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788639304.251709:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773091328:0@lo:39:umount.0 00000100:00080000:1.0:1788639304.251821:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788639304.251825:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788639304.251829:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788639304.252035:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773091456 00000100:00100000:0.0:1788639304.252042:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773091456 00000100:00100000:0.0:1788639304.252132:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639304.252142:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+24:3643:x1875523773091456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639304.252154:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639304.252170:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fae00/0x25c454990262d32b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d324 expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639304.252185:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639304.252240:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+23:3643:x1875523773091456:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639304.252247:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788639304.252310:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773091456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639304.252937:0:20812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.252948:0:20812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.252956:0:20812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.252963:0:20812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.253042:0:20812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639304.253050:0:20812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.253057:0:20812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.253064:0:20812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.253070:0:20812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.254692:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639304.254704:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.254716:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639304.254721:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.254733:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639304.254742:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639304.254748:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788639304.254751:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788639304.254792:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.254798:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639304.254837:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.254847:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639304.254865:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d225031-35be-4b74-b245-637fda218215:3644:1875523773091584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639304.254894:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639304.254898:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.254905:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b000 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639304.254909:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.254917:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639304.254924:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639304.254931:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788639304.254933:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:3.0:1788639304.254939:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639304.254951:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.254959:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639304.254979:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.254988:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639304.254991:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639304.254994:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639304.255006:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773091712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639304.255013:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773091584 00000100:00100000:3.0:1788639304.255021:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773091584 00000100:00100000:2.0:1788639304.255042:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639304.255067:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773091712 00000100:00100000:3.0:1788639304.255072:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773091712 00000100:00100000:3.0:1788639304.255091:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788639304.255099:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+24:3644:x1875523773091584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639304.255111:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639304.255125:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef4e00/0x25c454990262d27c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d275 expref: 24 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639304.255139:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639304.255178:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+23:3644:x1875523773091584:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (242us total) trans 0 rc 0/0 00010000:00010000:1.0:1788639304.255178:0:20812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788639304.255187:0:20812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639304.255188:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 10000000:01000000:1.0:1788639304.255205:0:20812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:3.0:1788639304.255210:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788639304.255215:0:20812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639304.255220:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3820c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+22:3641:x1875523773091712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639304.255231:0:20812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639304.255236:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639304.255242:0:20812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639304.255249:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef4000/0x25c454990262d688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d681 expref: 22 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.255251:0:20812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639304.255260:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639304.255287:0:20812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639304.255295:0:20812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639304.255302:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3820c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+21:3641:x1875523773091712:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (260us total) trans 0 rc 0/0 00010000:00010000:1.0:1788639304.255306:0:20812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639304.255313:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788639304.255319:0:20812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.255326:0:20812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639304.255336:0:20812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788639304.255339:0:20812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788639304.255343:0:20812:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788639304.255380:0:20812:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000100:00100000:3.0:1788639304.255381:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773091712:0@lo:103:ldlm_bl.0 00000020:01000000:1.0:1788639304.255387:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788639304.255392:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788639304.255397:0:20812:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788639304.255404:0:20812:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ae369172000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:3.0:1788639304.255409:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d225031-35be-4b74-b245-637fda218215:3644:1875523773091584:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788639304.255414:0:20812:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ae3691c1800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788639304.255420:0:20812:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ae3506e8800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788639304.255426:0:20812:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ae367fcf800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788639304.255432:0:20812:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ae36d08f000 64907637-38d0-4ad4-9e99-06074f162345 192.168.206.18@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1788639304.255437:0:20812:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ae369170000 5f164030-9448-43be-b8f2-64db35b5d669 192.168.206.18@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:1.0:1788639304.255448:0:20812:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9ae375c5cd40) has exports, disconnecting them 00000020:00080000:1.0:1788639304.255463:0:20812:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ae369172000), last request at 1788639302 00000020:00000080:1.0:1788639304.255471:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d650 00000100:00080000:1.0:1788639304.255487:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ae369177800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788639304.255527:0:20812:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae369172000): rc 0 00000020:00000080:1.0:1788639304.255530:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae369172000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788639304.255548:0:20812:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ae3691c1800), last request at 1788639302 00000020:00000080:1.0:1788639304.255551:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d4f2 00000100:00080000:1.0:1788639304.255556:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ae3691c7800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788639304.255563:0:20812:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae3691c1800): rc 0 00000020:00000080:1.0:1788639304.255565:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae3691c1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788639304.255570:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae369172000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:1.0:1788639304.255582:0:20812:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ae3506e8800), last request at 1788639239 00000020:00000080:1.0:1788639304.255585:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d443 00000100:00080000:1.0:1788639304.255589:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ae3506e8000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788639304.255594:0:20812:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae3506e8800): rc 0 00000020:00000080:1.0:1788639304.255596:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae3506e8800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788639304.255602:0:20812:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ae367fcf800), last request at 1788639239 00000020:00000080:1.0:1788639304.255606:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d3e1 00000020:00000080:0.0:1788639304.255608:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3691c1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1788639304.255610:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ae346550000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788639304.255644:0:20812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00000080:0.0:1788639304.255677:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae369177800 for lustre-MDT0000 00000020:00000080:0.0:1788639304.255683:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3506e8800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788639304.255703:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae3691c7800 for lustre-MDT0000 00000020:00080000:1.0:1788639304.255715:0:20812:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae367fcf800): rc 0 00000004:00000080:1.0:1788639304.255722:0:20812:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaea581d9fae0 00000020:00000080:0.0:1788639304.255729:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae3506e8000 for lustre-MDT0000 00000100:00080000:1.0:1788639304.255741:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788639304.255745:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788639304.256464:0:20812:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788639304.256486:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddee000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788639304.256667:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639304.256684:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.256693:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78aa00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639304.256697:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.256707:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639304.256713:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639304.256719:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788639304.256721:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788639304.256724:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788639304.256748:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.256754:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639304.256778:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.256785:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.256801:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639304.256805:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.256811:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ba00 already unused, calling callback (ffffffffc131ec20) 00000100:00100000:0.0:1788639304.256818:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773091968:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1788639304.256822:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.256832:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639304.256840:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639304.256846:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788639304.256848:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788639304.256851:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788639304.256868:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639304.256868:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639304.256878:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639304.256895:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.256903:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.256916:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639304.256917:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773092096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639304.256919:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639304.256924:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639304.256934:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639304.256940:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639304.256945:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639304.256975:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773091968 00000100:00100000:2.0:1788639304.256981:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773091968 00000100:00100000:2.0:1788639304.257031:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773092096 00000100:00100000:3.0:1788639304.257033:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773091840:0@lo:39:umount.0 00000100:00100000:2.0:1788639304.257035:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773092096 00000100:00100000:2.0:1788639304.257061:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788639304.257072:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639304.257082:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d225031-35be-4b74-b245-637fda218215+22:3642:x1875523773091968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639304.257095:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788639304.257106:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773091840 00010000:00010000:2.0:1788639304.257110:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fa400/0x25c454990262d825 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d81e expref: 22 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639304.257111:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773091840 00010000:00010000:2.0:1788639304.257125:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639304.257141:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788639304.257150:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875523773091840:12345-0@lo:39:umount.0 00000100:00100000:2.0:1788639304.257166:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d225031-35be-4b74-b245-637fda218215+21:3642:x1875523773091968:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (298us total) trans 0 rc 0/0 00000020:00000080:3.0:1788639304.257171:0:17246:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d46d 00000100:00100000:2.0:1788639304.257175:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788639304.257179:0:17246:0:(import.c:65:import_set_state_nolock()) ffff9ae375ea3000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788639304.257196:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000001:00000004:3.0:1788639304.257201:0:17246:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788639304.257207:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d225031-35be-4b74-b245-637fda218215+20:3643:x1875523773092096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639304.257217:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639304.257226:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2421f8e00/0x25c454990262d26e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d267 expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639304.257234:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639304.257275:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d225031-35be-4b74-b245-637fda218215+19:3643:x1875523773092096:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639304.257281:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788639304.257327:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3640:x1875523773091840:12345-0@lo:39:umount.0 Request processed in 178us (257us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788639304.257335:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1788639304.257363:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639304.257426:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773091968:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788639304.257451:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788639304.257466:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773092096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788639304.257471:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1788639304.257490:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788639304.257544:0:20812:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788639304.257556:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddef800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788639304.257564:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788639304.257566:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1788639304.257583:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788639304.257662:0:20812:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788639304.257672:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788639304.257716:0:20812:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ae375c5cd40) has no exports 00000100:00100000:2.0:1788639304.257839:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773092224:0@lo:9:umount.0 00000100:00100000:2.0:1788639304.257873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639304.257903:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773092352:0@lo:9:umount.0 00000100:00100000:2.0:1788639304.257923:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639304.257952:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773092224 00000100:00100000:0.0:1788639304.257958:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773092224 00000100:00080000:2.0:1788639304.257964:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddee000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788639304.257972:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773091840:0@lo:39:umount.0 00000100:00100000:0.0:1788639304.258020:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773092352 00000100:00100000:0.0:1788639304.258025:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773092352 00000100:00100000:0.0:1788639304.258052:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788639304.258061:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875523773092224:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788639304.258079:0:19077:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d531 00000100:00080000:0.0:1788639304.258086:0:19077:0:(import.c:65:import_set_state_nolock()) ffff9ae3691c0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788639304.258123:0:19077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788639304.258149:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788639304.258165:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875523773092352:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788639304.258181:0:18747:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d68f 00000100:00080000:2.0:1788639304.258189:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9ae24226a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788639304.258226:0:18747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788639304.258232:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3640:x1875523773092224:12345-0@lo:9:umount.0 Request processed in 173us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639304.258240:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1788639304.258262:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788639304.258280:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddef800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788639304.258287:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788639304.258289:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639304.258291:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773092224:0@lo:9:umount.0 00000100:00080000:3.0:1788639304.258348:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639304.258353:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639304.258399:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3640:x1875523773092352:12345-0@lo:9:umount.0 Request processed in 235us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639304.258408:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788639304.258468:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788639304.258485:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788639304.258488:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639304.258491:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773092352:0@lo:9:umount.0 00010000:00010000:0.0:1788639304.258715:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788639304.260762:0:18744:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788639304.260774:0:18744:0:(genops.c:885:class_export_put()) final put ffff9ae3691c7000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788639304.260802:0:18744:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f164030-9448-43be-b8f2-64db35b5d669 00000020:00000080:1.0:1788639304.260804:0:18744:0:(genops.c:885:class_export_put()) final put ffff9ae242d30000/5f164030-9448-43be-b8f2-64db35b5d669 00000001:00100000:1.0:1788639304.260812:0:18744:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64907637-38d0-4ad4-9e99-06074f162345 00000020:00000080:1.0:1788639304.260814:0:18744:0:(genops.c:885:class_export_put()) final put ffff9ae242d33800/64907637-38d0-4ad4-9e99-06074f162345 00000020:00000080:3.0:1788639304.260833:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3691c7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788639304.260909:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242d30000/5f164030-9448-43be-b8f2-64db35b5d669 for lustre-OST0000 00000020:00000080:3.0:1788639304.260940:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242d33800/64907637-38d0-4ad4-9e99-06074f162345 for lustre-OST0000 00000020:00000080:3.0:1788639304.260955:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae3691c0800 for lustre-OST0000 00000020:00000080:3.0:1788639304.260968:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae242d36000 for lustre-OST0000 00000020:00000080:3.0:1788639304.260972:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae242d30800 for lustre-OST0000 00000020:00080000:1.0:1788639304.265233:0:20812:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ae375c5cd40) has no exports 00000001:00100000:2.0:1788639304.266232:0:19562:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788639304.266240:0:19562:0:(genops.c:885:class_export_put()) final put ffff9ae24226b000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788639304.266343:0:19562:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64907637-38d0-4ad4-9e99-06074f162345 00000020:00000080:2.0:1788639304.266346:0:19562:0:(genops.c:885:class_export_put()) final put ffff9ae374820800/64907637-38d0-4ad4-9e99-06074f162345 00000001:00100000:2.0:1788639304.266354:0:19562:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f164030-9448-43be-b8f2-64db35b5d669 00000020:00000080:2.0:1788639304.266357:0:19562:0:(genops.c:885:class_export_put()) final put ffff9ae36d088800/5f164030-9448-43be-b8f2-64db35b5d669 00000020:00000080:0.0:1788639304.266562:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae24226b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788639304.266683:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae374820800/64907637-38d0-4ad4-9e99-06074f162345 for lustre-OST0001 00000020:00000080:0.0:1788639304.266703:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d088800/5f164030-9448-43be-b8f2-64db35b5d669 for lustre-OST0001 00000020:00000080:0.0:1788639304.266722:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae24226a000 for lustre-OST0001 00000020:00000080:0.0:1788639304.266727:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae374823800 for lustre-OST0001 00000020:00000080:0.0:1788639304.266731:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae36d088000 for lustre-OST0001 00000020:00000080:1.0:1788639304.313842:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d2c2 00000020:00000080:1.0:1788639304.313858:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae36dded800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788639304.313888:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788639304.313969:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639304.313991:0:20812:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788639304.313998:0:20812:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9ae241ee4d40) has no exports 00000020:00000080:2.0:1788639304.314116:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36dded800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788639304.315075:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d2bb 00000020:00000080:0.0:1788639304.315091:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae375cad800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788639304.315151:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375cad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788639304.315183:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639304.318987:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788639304.319002:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae375ca9000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788639304.319009:0:20812:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375ca9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788639304.319032:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788639305.013657:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639305.398739:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773092480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639305.398833:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639305.399263:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773092480 00000100:00100000:0.0:1788639305.399274:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773092480 00000100:00100000:0.0:1788639305.399398:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788639305.399409:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773092480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639305.399457:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788639305.399542:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773092480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639305.399550:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788639305.399683:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773092480:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788639305.401920:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639305.910012:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773092608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639305.910243:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639305.910278:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773092608 00000100:00100000:1.0:1788639305.910290:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773092608 00000100:00100000:1.0:1788639305.910356:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788639305.910366:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875523773092608:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788639305.910375:0:17245:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788639305.910426:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875523773092608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (182us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788639305.910434:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:02020000:0.0:1788639305.912585:0:3641:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:3.0:1788639305.918069:0:17221:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788639305.918083:0:17221:0:(genops.c:885:class_export_put()) final put ffff9ae367fcf800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788639305.918120:0:17221:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 64907637-38d0-4ad4-9e99-06074f162345 00000001:00080000:3.0:1788639305.918128:0:17221:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1788639305.918132:0:17221:0:(genops.c:885:class_export_put()) final put ffff9ae36d08f000/64907637-38d0-4ad4-9e99-06074f162345 00000001:00100000:3.0:1788639305.919168:0:17221:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5f164030-9448-43be-b8f2-64db35b5d669 00000001:00080000:3.0:1788639305.919178:0:17221:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1788639305.919189:0:17221:0:(genops.c:885:class_export_put()) final put ffff9ae369170000/5f164030-9448-43be-b8f2-64db35b5d669 00000020:00000080:2.0:1788639305.919490:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae367fcf800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788639305.919561:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d08f000/64907637-38d0-4ad4-9e99-06074f162345 for lustre-MDT0000 00000020:00000080:2.0:1788639305.919588:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae369170000/5f164030-9448-43be-b8f2-64db35b5d669 for lustre-MDT0000 00000020:00000080:2.0:1788639305.919818:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae346550000 for lustre-MDT0000 00000020:00000080:2.0:1788639305.919825:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae36d08d000 for lustre-MDT0000 00000020:00000080:2.0:1788639305.919828:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae369174800 for lustre-MDT0000 00000001:00100000:3.0:1788639305.922551:0:17973:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788639305.922570:0:17973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788639305.922577:0:17973:0:(genops.c:885:class_export_put()) final put ffff9ae375ea1000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788639305.922600:0:17973:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 64907637-38d0-4ad4-9e99-06074f162345 00000001:00080000:3.0:1788639305.922606:0:17973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788639305.922608:0:17973:0:(genops.c:885:class_export_put()) final put ffff9ae34a98b800/64907637-38d0-4ad4-9e99-06074f162345 00000001:00100000:3.0:1788639305.922613:0:17973:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5f164030-9448-43be-b8f2-64db35b5d669 00000001:00080000:3.0:1788639305.922635:0:17973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788639305.922637:0:17973:0:(genops.c:885:class_export_put()) final put ffff9ae369175800/5f164030-9448-43be-b8f2-64db35b5d669 00000020:00000080:2.0:1788639305.923247:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375ea1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788639305.923322:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae34a98b800/64907637-38d0-4ad4-9e99-06074f162345 for lustre-MDT0001 00000020:00000080:2.0:1788639305.923349:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae369175800/5f164030-9448-43be-b8f2-64db35b5d669 for lustre-MDT0001 00000020:00000080:2.0:1788639305.923376:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae375ea3000 for lustre-MDT0001 00000020:00000080:2.0:1788639305.923403:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae3461e3800 for lustre-MDT0001 00000020:00000080:2.0:1788639305.923407:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae369175000 for lustre-MDT0001 00000100:00080000:0.0:1788639305.925566:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788639305.925577:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788639305.925583:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788639305.938112:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788639305.938132:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1788639305.938155:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ae375c2e000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788639305.938210:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae3748a9500 x1875523773092736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639305.938414:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773092736:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788639305.938518:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639305.938652:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773092736 00000100:00100000:3.0:1788639305.938662:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773092736 00000100:00100000:3.0:1788639305.938732:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788639305.938750:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875523773092736:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788639305.938771:0:17981:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788639305.944522:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875523773092736:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 5763us (5995us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788639305.944541:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788639305.945479:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788639305.945490:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788639305.945496:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773092736:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1788639306.039953:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788639306.356901:0:20812:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae36cddee40 - data ffff9ae3788a85e8/ffff9ae36cf66800 00000020:01000000:0.0:1788639306.357125:0:20812:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae343eb57e0 - data ffff9ae3789baa20/ffff9ae36ec30c00 00000001:00000004:0.0:1788639306.366886:0:20812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1788639306.414867:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788639306.414879:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788639306.415312:0:20812:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ae375c48000 x1875523773091840/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788639314 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639306.415469:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788639306.418014:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788639306.418025:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788639306.418047:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788639306.418050:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788639306.418568:0:17264:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788639306.418588:0:17264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1788639306.418601:0:17264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788639306.419956:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788639306.419963:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788639306.419984:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788639306.419987:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788639306.421452:0:17266:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788639306.421460:0:17266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1788639306.421475:0:17266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788639306.423145:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d28a 00000020:00000080:3.0:1788639306.423160:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae2416ef000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788639306.423347:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416ef000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788639306.425041:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d29f 00000020:00000080:3.0:1788639306.425056:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae2431ab800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788639306.425066:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788639306.425072:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639306.425082:0:20812:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788639306.425088:0:20812:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9ae3691ccd40) has no exports 00000020:00000080:1.0:1788639306.425182:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431ab800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1788639306.425376:0:20812:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788639306.425388:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d301 00000020:00000080:3.0:1788639306.425393:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae242ec3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788639306.425456:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788639306.425461:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639306.425467:0:20812:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788639306.425469:0:20812:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9ae241ee3380) has no exports 00000020:00000080:3.0:1788639306.425478:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d2fa 00000020:00000080:3.0:1788639306.425482:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae36ddeb000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788639306.426829:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242ec3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788639306.431420:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36ddeb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788639306.431668:0:20812:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788639306.431675:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788639306.431707:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788639306.431715:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788639306.431718:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788639306.431776:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639306.431787:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788639306.431797:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d2ec 00000020:00000080:3.0:1788639306.431807:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae375121800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788639306.431813:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788639306.431819:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639306.431824:0:20812:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788639306.431828:0:20812:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ae241ee0000) has no exports 00000020:00000080:3.0:1788639306.431836:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d2e5 00000020:00000080:3.0:1788639306.431839:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae36dde9800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788639306.432378:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae375cad000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788639306.432387:0:36:0:(genops.c:885:class_export_put()) final put ffff9ae375127000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788639306.432389:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375127000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788639306.432395:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788639306.432510:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375121800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788639306.432515:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36dde9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788639306.432609:0:20812:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788639306.432677:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788639306.432681:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1788639306.432687:0:20812:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788639306.432690:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788639306.432760:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639306.432768:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788639306.432784:0:20812:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788639306.432792:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d2d7 00000020:00000080:3.0:1788639306.432799:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae375ca9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788639306.434652:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae36ddef800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788639306.434671:0:36:0:(genops.c:885:class_export_put()) final put ffff9ae375cae000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788639306.434674:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375cae000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788639306.434683:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788639306.434858:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788639306.434866:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639306.434875:0:20812:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788639306.434881:0:20812:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9ae37f71b380) has no exports 00000020:00000080:3.0:1788639306.434889:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d2d0 00000020:00000080:3.0:1788639306.434897:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae36dde9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788639306.436302:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375ca9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788639306.436322:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36dde9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788639306.483698:0:20812:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788639306.483711:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788639306.483717:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788639306.483741:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788639306.483920:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639306.483935:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788639306.483970:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639306.483973:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788639306.483980:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae2416e9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788639306.483986:0:20812:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416e9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788639306.483996:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788639306.484120:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d2a6 00000020:00000080:3.0:1788639306.484129:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae2431ad800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788639306.484134:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788639306.484138:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639306.484144:0:20812:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788639306.484148:0:20812:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9ae375c599c0) has no exports 00000020:00000080:3.0:1788639306.484171:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639306.484174:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788639306.484178:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d2ad 00000020:00000080:3.0:1788639306.484182:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae2431a8000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788639306.484193:0:20812:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae243aeb000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788639306.484196:0:20812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae243aeb000 3 00000020:01000004:3.0:1788639306.484200:0:20812:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae243aeb000 from lustre-MDT0000 00000020:00000080:3.0:1788639306.484219:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639306.484223:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788639306.484225:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae2416ed000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788639306.484227:0:20812:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416ed000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788639306.484235:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788639306.484269:0:20812:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788639306.484273:0:20812:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788639306.484276:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788639306.484279:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639306.484281:0:20812:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788639306.484289:0:20812:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9ae2439a7800 4d225031-35be-4b74-b245-637fda218215 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788639306.484301:0:20812:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9ae242f419c0) has exports, disconnecting them 00000020:00080000:3.0:1788639306.484306:0:20812:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ae2439a7800), last request at 1788639227 00000020:00000080:3.0:1788639306.484323:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d24b 00000020:00010000:3.0:1788639306.484328:0:20812:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae2439a7800: total 2 00000100:00080000:3.0:1788639306.484332:0:20812:0:(import.c:65:import_set_state_nolock()) ffff9ae2439a1000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788639306.484355:0:20812:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae2439a7800): rc 0 00000020:00080000:3.0:1788639306.484360:0:20812:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9ae242f419c0) has no exports 00000020:00010000:0.0:1788639306.484486:0:17229:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae2439a7800: total 2 00010000:00010000:0.0:1788639306.484538:0:17229:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae2439a7800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788639306.484582:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fba00/0x25c454990262d4b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d4ac expref: 14 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484609:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae37f78be00/0x25c454990262d611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d60a expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484698:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae37f78ac00/0x25c454990262d7fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d7f4 expref: 12 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484715:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fbc00/0x25c454990262d371 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d36a expref: 11 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484735:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef5000/0x25c454990262d4dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d4d6 expref: 10 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484758:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3748dce00/0x25c454990262d809 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d802 expref: 9 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484769:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef4600/0x25c454990262d42e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d427 expref: 8 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484780:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fa800/0x25c454990262d37f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d378 expref: 7 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484794:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef5c00/0x25c454990262d63b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d634 expref: 6 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484805:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef5a00/0x25c454990262d260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d259 expref: 5 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484816:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3748dc400/0x25c454990262d817 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d810 expref: 4 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484829:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fa000/0x25c454990262d38d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d386 expref: 3 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484841:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f9f800/0x25c454990262d67a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262d673 expref: 2 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639306.484851:0:17229:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae2439a7800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788639306.484867:0:17229:0:(genops.c:885:class_export_put()) final put ffff9ae2439a7800/4d225031-35be-4b74-b245-637fda218215 00010000:00010000:0.0:1788639306.484874:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639306.484876:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639306.484878:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639306.485057:0:17235:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ae342c33a00:17235] 1 exiting: rc = 0 00000100:00100000:1.0:1788639306.485182:0:17233:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ae3443a9a00:17233] 0 exiting: rc = 1 00000020:00000080:1.0:1788639306.485228:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae36ddee000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788639306.485235:0:36:0:(genops.c:885:class_export_put()) final put ffff9ae36dde8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788639306.485238:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36dde8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788639306.485242:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788639306.485328:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431ad800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788639306.485332:0:36:0:(genops.c:885:class_export_put()) final put ffff9ae2431ae800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788639306.485335:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431ae800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788639306.485338:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788639306.485369:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431a8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788639306.485374:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2439a7800/4d225031-35be-4b74-b245-637fda218215 for MGS 00000020:00000080:1.0:1788639306.485404:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2439a1000 for MGS 00000100:00100000:2.0:1788639306.486013:0:17236:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ae243144e00:17236] 2 exiting: rc = 0 00000100:00100000:1.0:1788639306.490556:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490573:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490581:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490588:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490595:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490603:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490637:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490759:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490766:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490773:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490780:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490786:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490796:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490804:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490810:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490816:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490822:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490829:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490839:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490846:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490852:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490857:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490862:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490868:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490873:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490879:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490913:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490920:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490927:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490933:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490939:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490945:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490951:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490957:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490963:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490968:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490974:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490979:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490985:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490991:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.490996:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491002:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491009:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491015:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491021:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491026:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491032:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491037:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491043:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491049:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491055:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491060:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491066:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491071:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491077:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491083:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491088:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491094:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491101:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491107:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491120:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491136:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491142:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639306.491152:0:20812:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788639306.494636:0:20812:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae36d0fab40 - data ffff9ae378a931b0/ffff9ae242fb7c00 00000020:01000000:1.0:1788639306.494826:0:20812:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae349283720 - data ffff9ae241866510/ffff9ae358575000 00000020:00000080:1.0:1788639306.495358:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d236 00000020:00000080:1.0:1788639306.495379:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae342c41800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788639306.495401:0:20812:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae243aeb000 from MGS, refs=2 00000020:01000004:1.0:1788639306.495406:0:20812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae243aeb000 2 00000020:01000004:1.0:1788639306.495410:0:20812:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae243aeb000 from MGS 00000020:00000080:0.0:1788639306.495476:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae342c41800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788639306.495533:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788639306.495542:0:20812:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788639306.495545:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae342c40800/MGS 00000020:00000080:1.0:1788639306.495548:0:20812:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae342c40800/MGS for MGS 00000020:01000000:1.0:1788639306.495556:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788639306.495676:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788639306.495681:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788639306.495688:0:20812:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788639306.495698:0:20812:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ae24239b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788639306.495704:0:20812:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9ae37f718000) has exports, disconnecting them 00000020:00080000:1.0:1788639306.495711:0:20812:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ae24239b800), last request at 1788639227 00000020:00000080:1.0:1788639306.495717:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d339 00000020:00080000:1.0:1788639306.495729:0:20812:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae24239b800): rc 0 00000020:00000080:1.0:1788639306.495734:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae24239b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788639306.496471:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae24239b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788639306.496727:0:20812:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788639306.496733:0:20812:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788639306.496738:0:20812:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788639306.496744:0:20812:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788639306.496768:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae3506eb000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788639306.496972:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639306.496979:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788639306.496984:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae3506ee800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788639306.496987:0:20812:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3506ee800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788639306.496992:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788639306.497084:0:20812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae243aeb000 1 00000020:00000080:0.0:1788639306.497091:0:20812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d228 00000020:00000080:0.0:1788639306.497097:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae342c46000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788639306.497106:0:20812:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788639306.497115:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae342c46000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788639306.497124:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639306.497129:0:20812:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788639306.497132:0:20812:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9ae3691cb380) has no exports 00000020:00000080:2.0:1788639306.617539:0:20812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639306.617553:0:20812:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788639306.617558:0:20812:0:(genops.c:885:class_export_put()) final put ffff9ae243aed000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788639306.617563:0:20812:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae243aed000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788639306.617575:0:20812:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788639306.617859:0:20812:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ae243ae9000 00000020:02000400:2.0:1788639306.617934:0:20812:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788639307.062991:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639307.446786:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788639307.446793:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788639307.446797:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639307.446804:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 564 00000100:00080000:3.0:1788639307.446810:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788639307.446816:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ae375c2e000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639307.446839:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae36ce73100 x1875523773092992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639307.446945:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773092864:0@lo:400:kworker.0 00000400:00000100:2.0:1788639307.447004:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875523773092864 offset 0 length 224: 4 00000100:00100000:2.0:1788639307.447039:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773093504:0@lo:400:kworker.0 00000100:00100000:2.0:1788639307.447069:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639307.447109:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773093376:0@lo:400:kworker.0 00000100:00100000:3.0:1788639307.447143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639307.447177:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773093888:0@lo:400:kworker.0 00000100:00100000:3.0:1788639307.447199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639307.447229:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773092992:0@lo:38:kworker.0 00000100:00100000:3.0:1788639307.447253:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639307.447280:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773093120:0@lo:400:kworker.0 00000100:00100000:3.0:1788639307.447303:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639307.447321:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773093632:0@lo:400:kworker.0 00000100:00100000:3.0:1788639307.447353:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639307.447370:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788639307.447374:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773093248:0@lo:400:kworker.0 00000100:00100000:3.0:1788639307.447393:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639307.447410:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773093760:0@lo:400:kworker.0 00000100:00100000:3.0:1788639307.447427:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639307.447461:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773093504 00000100:00100000:3.0:1788639307.447468:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773093504 00000100:00100000:3.0:1788639307.447495:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773093376 00000100:00100000:3.0:1788639307.447497:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773093376 00000100:00100000:3.0:1788639307.447504:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773093888 00000100:00100000:3.0:1788639307.447506:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773093888 00000100:00100000:3.0:1788639307.447528:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773093632 00000100:00100000:3.0:1788639307.447531:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773093632 00000100:00100000:3.0:1788639307.447543:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773093760 00000100:00100000:3.0:1788639307.447545:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773093760 00000100:00100000:3.0:1788639307.447556:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788639307.447564:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523773093888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639307.447608:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523773093888:12345-0@lo:400:kworker.0 Request processed in 44us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639307.447645:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788639307.447663:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788639307.447669:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773093632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639307.447699:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773093632:12345-0@lo:400:kworker.0 Request processed in 30us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639307.447704:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788639307.447715:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788639307.447719:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875523773093504:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788639307.447732:0:17241:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788639307.447760:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875523773093504:12345-0@lo:400:kworker.0 Request processed in 40us (691us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788639307.447766:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788639307.447778:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788639307.447782:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875523773093376:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788639307.447786:0:17241:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788639307.447807:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875523773093376:12345-0@lo:400:kworker.0 Request processed in 24us (664us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788639307.447812:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788639307.447822:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788639307.447825:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875523773093760:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788639307.447830:0:17241:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788639307.448112:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1875523773093760:12345-0@lo:400:kworker.0 Request processed in 22us (421us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788639307.448120:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788639307.448139:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773092992 00000100:00100000:3.0:1788639307.448142:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773092992 00000100:00100000:3.0:1788639307.448170:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788639307.448175:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875523773092992:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788639307.448192:0:17246:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788639307.449165:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639307.449182:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773093120 00000100:00100000:1.0:1788639307.449188:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773093120 00000100:00100000:1.0:1788639307.449234:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773093248 00000100:00100000:1.0:1788639307.449238:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773093248 00000100:00100000:1.0:1788639307.449256:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788639307.449263:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773093120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639307.449330:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773093120:12345-0@lo:400:kworker.0 Request processed in 67us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639307.449337:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788639307.449354:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788639307.449360:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773093248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639307.449388:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773093248:12345-0@lo:400:kworker.0 Request processed in 29us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639307.449393:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788639307.449462:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639307.449466:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639307.449713:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773093248:0@lo:400:kworker.0 00000100:00080000:2.0:1788639307.449725:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788639307.449729:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ae242d36800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788639307.449733:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788639307.449738:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ae242d36800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639307.449748:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 525 00000100:00080000:2.0:1788639307.449753:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae242d36800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639307.449776:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2432c9500 x1875523773094144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639307.449802:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773093760:0@lo:400:kworker.0 00000100:00100000:2.0:1788639307.449817:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773093120:0@lo:400:kworker.0 00010000:00080000:2.0:1788639307.449833:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9ae36ce71f80 x1875523773093632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639307.449843:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773093632:0@lo:400:kworker.0 00000100:00080000:2.0:1788639307.449888:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788639307.449892:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9ae2432a2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788639307.449895:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788639307.449898:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9ae2432a2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639307.449901:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:2.0:1788639307.449904:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ae2432a2800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639307.449918:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2432c8000 x1875523773094272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639307.449928:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773093376:0@lo:400:kworker.0 00010000:00080000:2.0:1788639307.449939:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9ae36ce73800 x1875523773093888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639307.449947:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773093888:0@lo:400:kworker.0 00000100:00100000:2.0:1788639307.449958:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639307.449973:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773094016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639307.450006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639307.450041:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773094016 00000100:00100000:2.0:1788639307.450045:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773094016 00000100:00100000:2.0:1788639307.450073:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788639307.450080:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773094016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639307.450101:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788639307.450136:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773094016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639307.450142:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788639307.450174:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773094016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639307.452007:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773094144:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788639307.452065:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639307.452094:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875523773094272:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788639307.452115:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639307.452150:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773094144 00000100:00100000:1.0:1788639307.452156:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773094144 00000100:00100000:1.0:1788639307.452185:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773094272 00000100:00100000:1.0:1788639307.452189:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773094272 00000100:00100000:1.0:1788639307.452207:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788639307.452213:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875523773094144:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788639307.452231:0:18565:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788639307.452271:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875523773094144:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 56us (205us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788639307.452277:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788639307.452293:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788639307.452297:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875523773094272:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788639307.452306:0:18565:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788639307.452340:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875523773094272:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 41us (224us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788639307.452346:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788639307.452382:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae242d36800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639307.452387:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788639307.452391:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773094144:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788639307.452400:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2432a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639307.452402:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788639307.452405:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875523773094272:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788639307.455093:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788639307.455099:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ae3691c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788639307.455103:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788639307.455109:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ae3691c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639307.455113:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 510 00000100:00080000:2.0:1788639307.455122:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ae3691c4000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639307.455150:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2432cb800 x1875523773094400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639307.455180:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773093504:0@lo:400:kworker.0 00000100:00100000:1.0:1788639307.455244:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523773094400:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788639307.455294:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639307.455378:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773094400 00000100:00100000:2.0:1788639307.455384:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773094400 00000100:00100000:2.0:1788639307.455421:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788639307.455428:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875523773094400:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788639307.455458:0:18565:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788639307.455505:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875523773094400:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 76us (210us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788639307.455512:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788639307.455581:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae3691c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639307.455585:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788639307.455589:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523773094400:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788639307.468388:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875523773092992:12345-0@lo:38:kworker.0 Request processed in 20207us (21128us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788639307.468401:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788639307.468497:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639307.468503:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788639307.468507:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773092992:0@lo:38:kworker.0 00010000:00010000:0.0:1788639308.085317:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639309.108907:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788639309.390930:0:21012:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788639309.409892:0:21012:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788639309.409953:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.409968:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.409975:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.409982:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.410004:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788639309.410010:0:21012:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788639309.410037:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788639309.410042:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788639309.410047:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788639309.410053:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9ae2432a2800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788639309.410058:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788639309.410059:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788639309.410063:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788639309.410888:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.410912:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.410918:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.410925:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.410951:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788639309.410957:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.410965:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.410971:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.410977:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.410988:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788639309.410994:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.411001:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.411017:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.411023:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.411031:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788639309.411036:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.411042:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.411048:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.411054:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639309.411061:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:2.0:1788639309.411064:0:21012:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788639309.411098:0:21012:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788639309.411102:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788639309.411106:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788639309.411111:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788639309.411118:0:21012:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9ae242269000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788639309.411125:0:21012:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9ae2433ec000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788639309.411129:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000020:00080000:2.0:1788639309.411130:0:21012:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9ae242f44d40) has exports, disconnecting them 00010000:00010000:0.0:1788639309.411138:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788639309.411143:0:21012:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ae242269000), last request at 1788639307 00010000:00010000:0.0:1788639309.411152:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a000 already unused, calling callback (ffffffffc131ec20) 00000020:00000080:2.0:1788639309.411153:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d665 10000000:00010000:0.0:1788639309.411157:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788639309.411172:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9ae24226a800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788639309.411183:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639309.411191:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639309.411197:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788639309.411199:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000020:00080000:2.0:1788639309.411214:0:21012:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae242269000): rc 0 00000020:00000080:2.0:1788639309.411217:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae242269000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788639309.411225:0:21012:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ae2433ec000), last request at 1788639307 00000020:00000080:2.0:1788639309.411229:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d507 00000100:00080000:2.0:1788639309.411233:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9ae2433eb800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788639309.411239:0:21012:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae2433ec000): rc 0 00000020:00000080:2.0:1788639309.411240:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae2433ec000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788639309.411247:0:21012:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffaea581c7fae0 00000100:00080000:2.0:1788639309.411265:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788639309.411273:0:21012:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9ae2432c8a80 x1875523773092608/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788639321 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788639309.411282:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1788639309.411292:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788639309.411320:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411329:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639309.411354:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411362:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411378:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788639309.411381:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411387:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9e00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639309.411390:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411397:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639309.411414:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639309.411420:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788639309.411422:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1788639309.411423:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1788639309.411524:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411531:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639309.411539:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411545:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411556:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788639309.411559:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411564:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78bc00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639309.411567:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411574:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639309.411579:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639309.411595:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788639309.411597:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788639309.411599:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788639309.411643:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411651:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639309.411662:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411667:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411683:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639309.411686:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411690:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ea00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639309.411692:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411699:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639309.411715:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639309.411721:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788639309.411722:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788639309.411730:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788639309.411746:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.411760:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639309.411768:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.412001:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.412013:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639309.412016:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.412020:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9c00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639309.412023:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.412030:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639309.412037:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639309.412042:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788639309.412044:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788639309.412047:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1788639309.412049:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773094784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639309.412064:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.412071:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639309.412084:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.412090:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639309.412102:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639309.412104:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639309.412107:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639309.412117:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639309.412118:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639309.412130:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773094528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639309.412165:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639309.412168:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773092608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639309.412192:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773095040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639309.412200:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639309.412208:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773094912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639309.412232:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639309.412262:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773094784 00000100:00100000:2.0:1788639309.412268:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773094784 00000100:00100000:2.0:1788639309.412294:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773094528 00000100:00100000:2.0:1788639309.412297:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773094528 00000100:00100000:2.0:1788639309.412305:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773094912 00000100:00100000:2.0:1788639309.412307:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773094912 00000100:00100000:2.0:1788639309.412318:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788639309.412332:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1875523773094784:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788639309.412338:0:17227:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788639309 with bad export cookie 2721393090985382475 00000100:00100000:0.0:1788639309.412358:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639309.412372:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639309.412378:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773094656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639309.412397:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639309.412436:0:17228:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788639309.412445:0:17228:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788639309.412549:0:17226:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788639309.412557:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773095040 00000100:00100000:0.0:1788639309.412560:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773095040 00000100:00100000:0.0:1788639309.412577:0:17226:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788639309.412582:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773094656 00000100:00100000:0.0:1788639309.412585:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773094656 00010000:00010000:1.0:1788639309.412879:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788639309.412889:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242269000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788639309.412941:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2433ec000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788639309.412962:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae24226a800 for lustre-MDT0001 00000020:00000080:1.0:1788639309.412967:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2433eb800 for lustre-MDT0001 00000100:00080000:3.0:1788639309.413760:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788639309.413767:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1788639309.413974:0:21013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788639309.413984:0:21013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875523773094528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788639309.413990:0:21013:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788639309 with bad export cookie 2721393090985382475 00000100:00080000:3.0:1788639309.414063:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788639309.414068:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000100:00100000:0.0:1788639309.414075:0:21013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875523773094528:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (1906us total) trans 0 rc -107/-107 00000004:00080000:3.0:1788639309.414087:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639309.414097:0:21013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788639309.414130:0:21013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788639309.414135:0:21013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1875523773094912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788639309.414140:0:21013:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788639309 with bad export cookie 2721393090985382475 00000100:00080000:3.0:1788639309.414154:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788639309.414173:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9ae36d232000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788639309.414179:0:21013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1875523773094912:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (1945us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788639309.414187:0:21013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788639309.414188:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788639309.414192:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788639309.414199:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639309.414217:0:21013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788639309.414223:0:21013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875523773095040:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788639309.414227:0:21013:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788639309 with bad export cookie 2721393090985382475 00000100:00080000:3.0:1788639309.414258:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788639309.414260:0:21013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875523773095040:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (1904us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788639309.414268:0:21013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788639309.414283:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9ae36d235800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788639309.414284:0:21013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788639309.414293:0:21013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2430fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875523773094656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788639309.414298:0:21013:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788639309 with bad export cookie 2721393090985382475 00000100:00100000:0.0:1788639309.414334:0:21013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2430fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875523773094656:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (1935us total) trans 0 rc -107/-107 00000020:00080000:3.0:1788639309.414335:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9ae242f44d40) has no exports 00000100:00100000:0.0:1788639309.414343:0:21013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788639309.414529:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788639309.414533:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ae2416eb000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788639309.414542:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1788639309.415993:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773095168:0@lo:9:umount.0 00000100:00100000:0.0:1788639309.416052:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639309.416084:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773095296:0@lo:9:umount.0 00000100:00100000:0.0:1788639309.416108:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639309.422523:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1875523773094784:12345-0@lo:103:ldlm_bl.0 Request processed in 10186us (10401us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788639309.422534:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788639309.422652:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788639309.425670:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773095168 00000100:00100000:0.0:1788639309.425682:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773095168 00000100:00100000:0.0:1788639309.425762:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773095296 00000100:00100000:0.0:1788639309.425765:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773095296 00000100:00100000:0.0:1788639309.425794:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788639309.425804:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875523773095168:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788639309.425832:0:18750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d5f5 00000100:00080000:0.0:1788639309.425840:0:18750:0:(import.c:65:import_set_state_nolock()) ffff9ae3691c0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788639309.425882:0:18750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00080000:3.0:1788639309.426028:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639309.426033:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639309.426080:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1875523773095168:12345-0@lo:9:umount.0 Request processed in 278us (10027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639309.426088:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788639309.426104:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788639309.426110:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875523773095296:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788639309.426122:0:18750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d696 00000100:00080000:0.0:1788639309.426128:0:18750:0:(import.c:65:import_set_state_nolock()) ffff9ae24226e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788639309.426150:0:18750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788639309.426225:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1875523773095296:12345-0@lo:9:umount.0 Request processed in 115us (10115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639309.426231:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788639309.426257:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639309.426263:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639309.427495:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d232000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788639309.427518:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788639309.427520:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788639309.427524:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773095168:0@lo:9:umount.0 00000100:00080000:3.0:1788639309.427537:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d235800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788639309.427543:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788639309.427544:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788639309.427546:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773095296:0@lo:9:umount.0 00000100:00080000:1.0:1788639309.438132:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.118@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788639309.438138:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788639309.438147:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae36ce73b80 x1875523773092864/t0(0) o400->MGC192.168.206.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788639323 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639309.438212:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae3748a9c00 x1875523773094784/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788639325 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639309.438221:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae3748ab800 x1875523773094528/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788639325 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639309.438230:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae3748a8380 x1875523773095040/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788639325 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639309.438238:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae3748ab480 x1875523773094912/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788639325 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639309.438246:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae3748aa680 x1875523773094656/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788639325 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788639309.438259:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9ae2416eb000 already not connected (conn 1, was 1): DISCONN 10000000:01000000:1.0:1788639309.438259:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788639309.438262:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788639309.438263:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788639309.438266:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ae2416eb000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788639309.438270:0:3643:0:(import.c:545:import_select_connection()) MGC192.168.206.118@tcp: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1788639309.438278:0:3643:0:(import.c:665:import_select_connection()) MGC192.168.206.118@tcp: import ffff9ae2416eb000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788639309.438336:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773092864:0@lo:400:kworker.0 00000100:00100000:0.0:1788639309.438373:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773094784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639309.438385:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773094912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639309.438418:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae3748ab480 x1875523773095424/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788639309.438479:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d225031-35be-4b74-b245-637fda218215:3640:1875523773095424:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788639309.438522:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875523773095424 offset 0 length 520: 4 00000100:00100000:0.0:1788639309.438581:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773094528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639309.438603:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773095040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639309.438647:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773094656:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788639309.443989:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9ae242f44d40) has no exports 00000020:01000000:2.0:1788639309.490475:0:21012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae36cddef60 - data ffff9ae37899daf8/ffff9ae36cf66400 00000020:01000000:2.0:1788639309.490686:0:21012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae343eb5960 - data ffff9ae37892f6c0/ffff9ae36ccf8000 00000001:00000004:2.0:1788639309.502782:0:21012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788639309.550589:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788639309.550597:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788639309.550604:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788639309.553539:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788639309.553546:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788639309.553581:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788639309.553584:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788639309.553799:0:17982:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788639309.553805:0:17982:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788639309.553814:0:17982:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788639309.554536:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788639309.554549:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788639309.554568:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788639309.554570:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788639309.555074:0:17984:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788639309.555078:0:17984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788639309.555086:0:17984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788639309.557129:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d39b 00000020:00000080:0.0:1788639309.557139:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae344f94000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788639309.558384:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d3b0 00000020:00000080:0.0:1788639309.558392:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae349a41800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788639309.558442:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae344f94000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788639309.558512:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788639309.558518:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639309.558526:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788639309.558530:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ae242f43380) has no exports 00000004:01000000:0.0:1788639309.558728:0:21012:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788639309.558737:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d404 00000020:00000080:0.0:1788639309.558742:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae2432a0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788639309.558852:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae349a41800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788639309.559062:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788639309.559070:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639309.559076:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788639309.559083:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9ae36a0e99c0) has no exports 00000020:00000080:0.0:1788639309.559088:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d3fd 00000020:00000080:0.0:1788639309.559093:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae36d234800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788639309.559112:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2432a0000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788639309.559569:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d234800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788639309.559786:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788639309.559790:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788639309.559795:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788639309.559800:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639309.559802:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788639309.559875:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639309.559882:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788639309.559887:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d3ef 00000020:00000080:0.0:1788639309.559897:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae36d231000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788639309.560208:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae36d235800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788639309.560214:0:36:0:(genops.c:885:class_export_put()) final put ffff9ae36d236000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788639309.560216:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d236000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788639309.560221:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788639309.560352:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788639309.560358:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639309.560363:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788639309.560366:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9ae241ee19c0) has no exports 00000020:00000080:0.0:1788639309.560371:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d3e8 00000020:00000080:0.0:1788639309.560375:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae36d233000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788639309.560393:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d231000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:0.0:1788639309.560834:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788639309.560838:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788639309.560841:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1788639309.560844:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639309.560846:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788639309.561038:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d233000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788639309.561115:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639309.561122:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788639309.561133:0:21012:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788639309.561139:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d3d3 00000020:00000080:0.0:1788639309.561145:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae375c2c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788639309.561166:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae36d232000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788639309.561172:0:36:0:(genops.c:885:class_export_put()) final put ffff9ae375124800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788639309.561174:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375124800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788639309.561178:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788639309.561242:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788639309.561246:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639309.561250:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788639309.561253:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9ae37f71cd40) has no exports 00000020:00000080:0.0:1788639309.561257:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d3cc 00000020:00000080:0.0:1788639309.561260:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae375c28000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788639309.561360:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375c2c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788639309.561368:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375c28000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788639309.562686:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788639309.562692:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788639309.562695:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788639309.562701:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788639309.562739:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639309.562744:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae375c2e000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788639309.562746:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788639309.562755:0:36:0:(genops.c:885:class_export_put()) final put ffff9ae375c28800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788639309.562759:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375c28800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788639309.562772:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788639309.562772:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788639309.562777:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788639309.562780:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae3490b6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788639309.562782:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3490b6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788639309.562787:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788639309.563077:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d3b7 00000020:00000080:1.0:1788639309.563083:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae349a42000/lustre-MDD0001_UUID 00000020:01000000:1.0:1788639309.563089:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788639309.563093:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788639309.563097:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788639309.563109:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ae242f40000) has no exports 00000020:00000080:1.0:1788639309.563134:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788639309.563138:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788639309.563142:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d3be 00000020:00000080:1.0:1788639309.563145:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae349a44800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788639309.563156:0:21012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae34303d000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788639309.563159:0:21012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae34303d000 2 00000020:01000004:1.0:1788639309.563161:0:21012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae34303d000 from lustre-MDT0001 00000020:00000080:1.0:1788639309.563176:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788639309.563178:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788639309.563180:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae344f90800/lustre-MDT0001_UUID 00000020:00000080:1.0:1788639309.563182:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae344f90800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788639309.563189:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788639309.563222:0:21012:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788639309.563225:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788639309.563227:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788639309.563230:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788639309.563235:0:21012:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9ae2432a6800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788639309.563239:0:21012:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9ae375c5b380) has exports, disconnecting them 00000020:00080000:1.0:1788639309.563244:0:21012:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9ae2432a6800), last request at 1788639239 00000020:00000080:1.0:1788639309.563247:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d43c 00000020:00080000:1.0:1788639309.563255:0:21012:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae2432a6800): rc 0 00000020:00000080:1.0:1788639309.563258:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae2432a6800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788639309.563326:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae349a42000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788639309.563331:0:36:0:(genops.c:885:class_export_put()) final put ffff9ae38018f000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788639309.563334:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae38018f000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788639309.563340:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788639309.563480:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae349a44800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788639309.563486:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2432a6800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788639309.581692:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788639309.581700:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788639309.581705:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788639309.581711:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788639309.582051:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2432a2800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788639309.582125:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639309.582133:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788639309.582138:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae2432a0800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788639309.582142:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2432a0800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788639309.582152:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788639309.582289:0:21012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae34303d000 1 00000020:00000080:0.0:1788639309.582295:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d363 00000020:00000080:0.0:1788639309.582301:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae343039000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788639309.582314:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788639309.582319:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639309.582323:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788639309.582327:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9ae375c58000) has no exports 00000020:00000080:3.0:1788639309.582383:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae343039000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788639309.607779:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788639309.607792:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788639309.607798:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae34303e800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788639309.607803:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae34303e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788639309.607813:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788639309.608140:0:21012:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ae34303f800 00000020:01000000:1.0:1788639309.608159:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788639309.608164:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788639309.608175:0:21012:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788639309.608183:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9ae3691c8000) has no exports 00000100:00100000:3.0:1788639309.608357:0:17240:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ae243144c00:17240] 0 exiting: rc = 1 00000100:00100000:0.0:1788639309.608372:0:18565:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ae36940f200:18565] 3 exiting: rc = 0 00000100:00100000:1.0:1788639309.608504:0:17242:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ae3585b2000:17242] 2 exiting: rc = 0 00000100:00100000:2.0:1788639309.608537:0:17241:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ae2416e0200:17241] 1 exiting: rc = 0 00000100:00100000:0.0:1788639309.608693:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608701:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608708:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608712:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608717:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608722:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608727:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608732:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608737:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608742:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608747:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608752:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608757:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608762:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608767:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608773:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608779:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608784:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608789:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608795:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608801:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608806:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608812:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608819:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608824:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608829:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608844:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608849:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608855:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608861:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608866:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608871:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608878:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608885:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608890:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608896:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608901:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608905:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608924:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608930:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608936:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608941:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608946:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608951:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608957:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608966:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608972:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608977:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608982:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608987:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608992:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.608997:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609008:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609013:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609018:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609024:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609029:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609034:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609040:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609045:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609050:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609062:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609068:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.609073:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639309.611613:0:17243:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ae3585b2e00:17243] 0 exiting: rc = 1 00000100:00100000:3.0:1788639309.611880:0:17244:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ae3585b3400:17244] 1 exiting: rc = 0 00000100:00100000:0.0:1788639309.612023:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612031:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612038:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612043:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612048:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612054:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612068:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612074:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612079:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612084:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612089:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612094:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612099:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612103:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612108:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612112:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612117:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612122:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612127:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612132:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612137:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612142:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612147:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612152:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612158:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612163:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612168:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612173:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612178:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612183:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612188:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612195:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612213:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612219:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612224:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612229:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612235:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612239:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612244:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612248:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612253:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612257:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612262:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612267:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612272:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612277:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612283:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612288:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612293:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612297:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612302:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612307:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612313:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612318:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612322:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612327:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612332:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612337:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612342:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612348:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612353:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612358:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612363:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.612369:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639309.614078:0:17981:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9ae36d07aa00:17981] 2 exiting: rc = 0 00000100:00100000:1.0:1788639309.614234:0:17245:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ae3585b2800:17245] 0 exiting: rc = 1 00000100:00100000:2.0:1788639309.614450:0:17246:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ae3585b2200:17246] 1 exiting: rc = 0 00000100:00100000:0.0:1788639309.614724:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614731:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614737:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614755:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614760:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614767:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614773:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614785:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614792:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614798:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614804:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614810:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614817:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614822:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614828:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614833:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614839:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614844:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614850:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614872:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614880:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614885:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614890:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614896:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614901:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614906:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614912:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614920:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614925:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614930:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614936:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614957:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614964:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614969:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614975:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614981:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614986:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.614991:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615003:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615009:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615014:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615019:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615025:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615045:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615052:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615058:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615064:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615069:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615075:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615080:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615091:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615100:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615105:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615110:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615116:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615136:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615143:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615149:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615155:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615161:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615167:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615172:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615177:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.615183:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639309.623840:0:17248:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ae34ad31400:17248] 1 exiting: rc = 0 00000100:00100000:1.0:1788639309.623846:0:17247:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ae3585b3e00:17247] 0 exiting: rc = 1 00000100:00100000:0.0:1788639309.623903:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623921:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623927:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623932:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623937:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623942:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623947:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623951:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623956:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623970:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623974:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623979:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623983:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623988:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623993:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.623997:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624001:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624006:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624010:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624014:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624019:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624023:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624027:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624031:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624035:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624040:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624044:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624048:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624053:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624057:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624061:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624065:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624069:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624073:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624078:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624088:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624095:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624100:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624105:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624110:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624115:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624120:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624131:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624136:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624149:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624161:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624165:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624170:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624176:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624181:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624186:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624190:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624196:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624202:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624207:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624391:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624400:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624405:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624410:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624415:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624420:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624434:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624440:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.624446:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639309.624766:0:17250:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ae350dfb200:17250] 1 exiting: rc = 0 00000100:00100000:0.0:1788639309.627756:0:17249:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ae346bf2800:17249] 0 exiting: rc = 1 00000100:00100000:0.0:1788639309.627854:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627861:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627865:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627870:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627875:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627879:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627884:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627888:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627892:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627898:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627902:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627907:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627911:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627915:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627934:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627938:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627943:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627948:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627952:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627956:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627961:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627965:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627969:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627973:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627977:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627981:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627985:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627989:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627994:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.627998:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628002:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628006:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628011:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628015:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628018:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628023:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628027:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628031:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628035:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628041:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628045:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628049:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628053:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628057:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628062:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628066:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628070:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628074:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628078:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628087:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628091:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628095:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628099:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628104:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628108:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628112:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628116:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628121:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628125:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628129:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628133:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628137:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628141:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.628146:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639309.629898:0:17252:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ae350dfa400:17252] 1 exiting: rc = 0 00000100:00100000:3.0:1788639309.630001:0:17251:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ae350dfb800:17251] 0 exiting: rc = 1 00000100:00100000:0.0:1788639309.630139:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630146:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630210:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630219:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630224:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630230:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630234:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630239:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630245:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630249:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630254:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630259:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630264:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630270:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630275:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630280:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630286:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630291:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630296:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630301:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630317:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630323:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630328:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630333:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630337:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630343:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630348:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630355:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630360:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630364:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630369:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630373:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630378:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630382:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630387:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630391:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630396:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630401:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630406:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630411:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630416:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630420:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630436:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630443:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630448:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630453:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630458:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630462:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630466:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630471:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630476:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630480:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630484:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630489:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630494:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630507:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630511:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630515:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630520:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630524:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630528:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630533:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630538:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.630543:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639309.631195:0:17254:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ae243145e00:17254] 1 exiting: rc = 0 00000100:00100000:0.0:1788639309.632304:0:17255:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ae2416e0600:17255] 2 exiting: rc = 0 00000100:00100000:1.0:1788639309.632592:0:17253:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ae350dfb000:17253] 0 exiting: rc = 1 00000100:00100000:0.0:1788639309.632871:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632880:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632886:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632893:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632900:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632906:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632911:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632916:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632922:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632927:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632932:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632937:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632942:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.632948:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633015:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633025:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633032:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633056:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633064:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633072:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633080:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633088:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633096:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633104:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633113:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633134:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633146:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633153:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633159:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633165:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633170:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633176:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633181:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633186:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633192:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633197:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633203:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633208:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633213:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633219:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633225:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633775:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633784:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633789:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633795:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633801:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633806:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633874:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633882:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633887:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633892:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633898:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633903:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633909:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633915:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633921:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633926:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633931:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633936:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.633941:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.634009:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.634015:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.634020:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639309.634025:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788639309.641826:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639309.641838:0:21012:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788639309.641843:0:21012:0:(genops.c:885:class_export_put()) final put ffff9ae2416ee800/MDS_uuid 00000020:00000080:0.0:1788639309.641847:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416ee800/MDS_uuid for MDS 00000020:01000000:0.0:1788639309.641852:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788639309.642015:0:21012:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788639310.133647:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639311.156767:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639312.181762:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788639312.355041:0:21215:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788639312.376864:0:21215:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788639312.376913:0:21215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639312.376926:0:21215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639312.376950:0:21215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639312.376957:0:21215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639312.377033:0:21215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788639312.377039:0:21215:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788639312.377064:0:21215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788639312.377068:0:21215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788639312.377074:0:21215:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788639312.377080:0:21215:0:(import.c:65:import_set_state_nolock()) ffff9ae3691c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788639312.377085:0:21215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788639312.377087:0:21215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788639312.377089:0:21215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788639312.377887:0:21215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788639312.377891:0:21215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788639312.377895:0:21215:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788639312.377914:0:21215:0:(import.c:65:import_set_state_nolock()) ffff9ae3506ed800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788639312.378424:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875523773095552:0@lo:39:umount.0 00000400:00000100:0.0:1788639312.378475:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773095552 offset 0 length 224: 4 00010000:00010000:2.0:1788639312.378570:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639312.378579:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639312.378588:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639312.378592:0:18396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639312.378600:0:18396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639312.378608:0:18396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639312.378613:0:18396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788639312.378648:0:18396:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788639312.378651:0:18396:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788639312.378665:0:18396:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae2416eb000 00010000:00010000:2.0:1788639312.378669:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639312.378676:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639312.380792:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639312.380799:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639312.380801:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639312.565724:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788639312.565734:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639312.565737:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788639312.565741:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788639312.565745:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae242d36800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639312.565753:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 566 00000100:00080000:3.0:1788639312.565759:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788639312.565781:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae242d36800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639312.565814:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc2300 x1875523773095680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788639312.565889:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773095680:0@lo:38:kworker.0 00000400:00000100:0.0:1788639312.565950:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773095680 offset 0 length 520: 4 00000100:00100000:1.0:1788639312.566119:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773095808:0@lo:400:kworker.0 00000400:00000100:1.0:1788639312.566143:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773095808 offset 0 length 224: 4 00010000:00010000:0.0:1788639313.204754:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639314.228757:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639314.612771:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788639314.612778:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639314.612781:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788639314.612784:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788639314.612869:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773095936:0@lo:400:kworker.0 00000400:00000100:0.0:1788639314.612917:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773095936 offset 0 length 224: 4 00000001:00100000:2.0:1788639315.131364:0:19562:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788639315.131373:0:19562:0:(genops.c:885:class_export_put()) final put ffff9ae242268800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788639315.131445:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242268800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788639315.131500:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae24226e800 for lustre-OST0001 00000001:00100000:0.0:1788639315.133933:0:18744:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788639315.133942:0:18744:0:(genops.c:885:class_export_put()) final put ffff9ae3691c4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788639315.134430:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3691c4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788639315.140033:0:13809:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae3691c0000 for lustre-OST0000 00010000:00010000:1.0:1788639315.252836:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639316.276794:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639317.300880:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788639317.621196:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788639317.621206:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788639317.621209:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788639317.621212:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788639317.621361:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639317.621380:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773096064:0@lo:400:kworker.0 00000400:00000100:1.0:1788639317.621438:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773096064 offset 0 length 224: 4 00010000:00010000:1.0:1788639318.324806:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639319.349452:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639319.733748:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639309/real 1788639309] req@ffff9ae3748ab480 x1875523773095424/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788639319 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639319.733850:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae3748ab480 x1875523773095424/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788639319 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788639319.733870:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2416eb000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788639319.733899:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788639319.733904:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d225031-35be-4b74-b245-637fda218215:3640:1875523773095424:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788639319.733950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639319.733956:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788639319.733959:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae2416eb000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639319.733974:0:36:0:(import.c:545:import_select_connection()) MGC192.168.206.118@tcp: connect to NID 0@lo last attempt 568 00000100:00080000:2.0:1788639319.733980:0:36:0:(import.c:630:import_select_connection()) MGC192.168.206.118@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788639319.733986:0:36:0:(import.c:665:import_select_connection()) MGC192.168.206.118@tcp: import ffff9ae2416eb000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639319.734013:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2432c8a80 x1875523773096192/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639319.734039:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639319.734043:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788639319.734095:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773096320:0@lo:400:kworker.0 00000400:00000100:2.0:1788639319.734142:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773096320 offset 0 length 224: 4 00000100:00100000:3.0:1788639319.734265:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d225031-35be-4b74-b245-637fda218215:3640:1875523773096192:0@lo:250:kworker.0 00000400:00000100:3.0:1788639319.734287:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875523773096192 offset 0 length 520: 4 00010000:00010000:2.0:1788639320.372824:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639321.397189:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639322.421180:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639322.805345:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639312/real 1788639312] req@ffff9ae342fc2a00 x1875523773095552/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788639322 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639322.805949:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae342fc2a00 x1875523773095552/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788639322 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788639322.806004:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae3506ed800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788639322.806104:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875523773095552:0@lo:39:umount.0 00000100:00080000:1.0:1788639322.806944:0:21215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788639322.806951:0:21215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788639322.806959:0:21215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788639322.809159:0:21215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639322.809185:0:21215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639322.809193:0:21215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639322.809218:0:21215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639322.809249:0:21215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639322.809257:0:21215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639322.809265:0:21215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639322.809271:0:21215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639322.809278:0:21215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639322.809309:0:21215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788639322.809315:0:21215:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1788639322.809322:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639322.809350:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639322.809373:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b200 already unused, calling callback (ffffffffc131ec20) 00000020:01000004:1.0:1788639322.809376:0:21215:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 10000000:00010000:2.0:1788639322.809379:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788639322.809384:0:21215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788639322.809394:0:21215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1788639322.809396:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788639322.809403:0:21215:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:00010000:2.0:1788639322.809407:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788639322.809411:0:21215:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9ae36a0eb380) has no exports 10000000:01000000:2.0:1788639322.809421:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788639322.809425:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788639322.809429:0:17229:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00080000:1.0:1788639322.809452:0:21215:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9ae36a0eb380) has no exports 00010000:00010000:2.0:1788639322.809453:0:17229:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae2416eb000 00010000:00010000:2.0:1788639322.809461:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639322.809469:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639322.809749:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639322.809754:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639322.809761:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e200 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639322.809765:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639322.809786:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639322.809793:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639322.809799:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788639322.809802:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788639322.809804:0:17229:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788639322.809811:0:17229:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae2416eb000 00010000:00010000:2.0:1788639322.809815:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639322.809823:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639322.809910:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639322.809913:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639322.809916:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639322.810856:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788639322.812006:0:21215:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae36d3979c0 - data ffff9ae37883abd0/ffff9ae36cebec00 00000020:01000000:1.0:1788639322.812223:0:21215:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae36dfd4d80 - data ffff9ae241834798/ffff9ae241619400 00100000:10000000:1.0:1788639322.820033:0:21215:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788639322.830077:0:21215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d4c1 00000020:00000080:3.0:1788639322.830092:0:21215:0:(genops.c:885:class_export_put()) final put ffff9ae2431e6000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788639322.830104:0:21215:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae375ea7800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788639322.830108:0:21215:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375ea7800 2 00000020:01000004:3.0:1788639322.830111:0:21215:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae375ea7800 from lustre-OST0000 00000020:00000080:3.0:1788639322.830134:0:21215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639322.830144:0:21215:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788639322.830146:0:21215:0:(genops.c:885:class_export_put()) final put ffff9ae2431e4000/lustre-OST0000_UUID 00000020:00000080:3.0:1788639322.830149:0:21215:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431e4000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788639322.830159:0:21215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788639322.830216:0:21215:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788639322.830220:0:21215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788639322.830224:0:21215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639322.830229:0:21215:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788639322.830235:0:21215:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ae3461e0800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788639322.830241:0:21215:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9ae3772499c0) has exports, disconnecting them 00000020:00080000:3.0:1788639322.830245:0:21215:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ae3461e0800), last request at 1788639252 00000020:00000080:3.0:1788639322.830250:0:21215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d4eb 00000020:00080000:3.0:1788639322.830260:0:21215:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae3461e0800): rc 0 00000020:00000080:3.0:1788639322.830264:0:21215:0:(genops.c:885:class_export_put()) final put ffff9ae3461e0800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788639322.831223:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431e6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788639322.831239:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3461e0800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788639322.832494:0:21215:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788639322.832510:0:21215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788639322.832515:0:21215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788639322.832527:0:21215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788639322.832585:0:13809:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae3691c4000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788639322.832813:0:21215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639322.832826:0:21215:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788639322.832832:0:21215:0:(genops.c:885:class_export_put()) final put ffff9ae3461e4000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788639322.832838:0:21215:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3461e4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788639322.832845:0:21215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788639322.832938:0:21215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788639322.832955:0:21215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788639322.832962:0:21215:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788639322.832969:0:21215:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9ae2431e3800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788639322.832975:0:21215:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9ae36a0e8000) has exports, disconnecting them 00000020:00080000:2.0:1788639322.832985:0:21215:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9ae2431e3800), last request at 1788639252 00000020:00000080:2.0:1788639322.832991:0:21215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d500 00000020:00080000:2.0:1788639322.833016:0:21215:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae2431e3800): rc 0 00000020:00000080:2.0:1788639322.833022:0:21215:0:(genops.c:885:class_export_put()) final put ffff9ae2431e3800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788639322.834632:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431e3800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788639322.835679:0:21215:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788639322.835689:0:21215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788639322.835693:0:21215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788639322.835701:0:21215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788639322.835736:0:13809:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae3506ed800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788639322.836664:0:21215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639322.836674:0:21215:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788639322.836679:0:21215:0:(genops.c:885:class_export_put()) final put ffff9ae2431e1000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788639322.836682:0:21215:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431e1000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788639322.836687:0:21215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788639322.836742:0:21215:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375ea7800 1 00000020:00000080:0.0:1788639322.836746:0:21215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d49e 00000020:00000080:0.0:1788639322.836751:0:21215:0:(genops.c:885:class_export_put()) final put ffff9ae3490b4000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788639322.836761:0:21215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788639322.836771:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3490b4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788639322.836785:0:21215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639322.836791:0:21215:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788639322.836796:0:21215:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9ae36cf0b380) has no exports 00000020:00000080:0.0:1788639322.883730:0:21215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639322.883744:0:21215:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788639322.883749:0:21215:0:(genops.c:885:class_export_put()) final put ffff9ae375ea2000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788639322.883754:0:21215:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375ea2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788639322.883766:0:21215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788639322.883941:0:21215:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ae375ea0000 00000020:02000400:0.0:1788639322.884000:0:21215:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788639323.445674:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639324.469788:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788639324.854996:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639324.855008:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788639324.855010:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639324.855013:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788639324.855092:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639324.855115:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773096448:0@lo:400:kworker.0 00000400:00000100:2.0:1788639324.855167:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773096448 offset 0 length 224: 4 00010000:00010000:3.0:1788639325.492943:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788639325.894681:0:21417:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788639325.909782:0:21417:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788639325.909863:0:21417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639325.909877:0:21417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639325.909885:0:21417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639325.909892:0:21417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639325.910405:0:21417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788639325.910412:0:21417:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788639325.910441:0:21417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788639325.910454:0:21417:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae342fc2300 x1875523773095680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788639327 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639325.910486:0:21417:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788639325.910492:0:21417:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788639325.910498:0:21417:0:(import.c:65:import_set_state_nolock()) ffff9ae242d36800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788639325.910503:0:21417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788639325.910507:0:21417:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae342fc2300 x1875523773095680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788639327 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639325.910515:0:21417:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788639325.910531:0:21417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1788639325.910735:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773095680:0@lo:38:kworker.0 00000100:00080000:0.0:1788639325.914502:0:21417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788639325.914520:0:21417:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae342fc0e00 x1875523773095808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639328 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639325.914552:0:21417:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae342fc1f80 x1875523773095936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639330 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639325.914632:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773095808:0@lo:400:kworker.0 00000100:00100000:0.0:1788639325.914777:0:21417:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae3748abb80 x1875523773096064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639333 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639325.914788:0:21417:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae2432cbb80 x1875523773096320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639335 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639325.914816:0:21417:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae2432cb480 x1875523773096448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639340 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639325.914824:0:21417:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788639325.914830:0:21417:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00010000:2.0:1788639325.915208:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639325.915218:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639325.915228:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639325.915232:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639325.915242:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639325.915250:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639325.915275:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788639325.915278:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788639325.915281:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788639325.915296:0:17230:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae2416eb000 00010000:00010000:2.0:1788639325.915300:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639325.915308:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639325.915349:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773096448:0@lo:400:kworker.0 00000100:00100000:3.0:1788639325.915447:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773095936:0@lo:400:kworker.0 00000100:00080000:0.0:1788639325.915728:0:21417:0:(import.c:65:import_set_state_nolock()) ffff9ae242268000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788639325.916044:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773096320:0@lo:400:kworker.0 00010000:00010000:2.0:1788639325.916072:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639325.916075:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639325.916077:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639325.916116:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773096064:0@lo:400:kworker.0 00000100:00100000:1.0:1788639325.916639:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875523773096576:0@lo:39:umount.0 00000400:00000100:1.0:1788639325.916686:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773096576 offset 0 length 224: 4 00010000:00010000:0.0:1788639326.518103:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639327.547379:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639328.565976:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639329.588871:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639329.972905:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788639329.972916:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788639330.612814:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639331.644555:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639332.661024:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639333.685161:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639334.132916:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639319/real 1788639319] req@ffff9ae2432c8a80 x1875523773096192/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788639334 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639334.132947:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae2432c8a80 x1875523773096192/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788639334 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788639334.132967:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2416eb000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639334.132988:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788639334.132992:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d225031-35be-4b74-b245-637fda218215:3640:1875523773096192:0@lo:250:kworker.0 00000100:00080000:3.0:1788639334.133229:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4d225031-35be-4b74-b245-637fda218215->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788639334.133240:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788639334.133245:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae2416eb000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639334.133254:0:36:0:(import.c:545:import_select_connection()) MGC192.168.206.118@tcp: connect to NID 0@lo last attempt 578 00000100:00080000:3.0:1788639334.133261:0:36:0:(import.c:630:import_select_connection()) MGC192.168.206.118@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788639334.133270:0:36:0:(import.c:665:import_select_connection()) MGC192.168.206.118@tcp: import ffff9ae2416eb000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639334.133328:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc1f80 x1875523773096704/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788639334.133426:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d225031-35be-4b74-b245-637fda218215:3640:1875523773096704:0@lo:250:kworker.0 00000400:00000100:1.0:1788639334.133490:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875523773096704 offset 0 length 520: 4 00010000:00010000:2.0:1788639334.708900:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639335.156776:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639325/real 1788639325] req@ffff9ae3748a9f80 x1875523773096576/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788639335 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639335.156818:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae3748a9f80 x1875523773096576/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788639335 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788639335.156841:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae242268000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788639335.156940:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875523773096576:0@lo:39:umount.0 00000100:00080000:0.0:1788639335.159309:0:21417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788639335.159320:0:21417:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788639335.159329:0:21417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788639335.163533:0:21417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639335.163559:0:21417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639335.163568:0:21417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639335.163596:0:21417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639335.163662:0:21417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639335.163671:0:21417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639335.166763:0:21417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639335.166775:0:21417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639335.166782:0:21417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639335.166825:0:21417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788639335.166833:0:21417:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788639335.166886:0:21417:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788639335.166892:0:21417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788639335.166899:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1788639335.166906:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:0.0:1788639335.166906:0:21417:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788639335.166913:0:21417:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9ae37724b380) has no exports 00010000:00010000:3.0:1788639335.166930:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639335.166941:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639335.166945:0:18396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788639335.166949:0:21417:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9ae37724b380) has no exports 00010000:00010000:3.0:1788639335.166960:0:18396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639335.166968:0:18396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639335.166974:0:18396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788639335.166998:0:18396:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788639335.167000:0:18396:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788639335.167021:0:18396:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae2416eb000 00010000:00010000:3.0:1788639335.167026:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639335.167034:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639335.167053:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639335.167057:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639335.167063:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9f400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639335.167066:0:18396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639335.167073:0:18396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639335.167079:0:18396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639335.167084:0:18396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788639335.167086:0:18396:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788639335.167087:0:18396:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788639335.167092:0:18396:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae2416eb000 00010000:00010000:3.0:1788639335.167094:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639335.167114:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639335.167144:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639335.167146:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639335.167148:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639335.167903:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788639335.171801:0:21417:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae36d0fade0 - data ffff9ae378a93000/ffff9ae374898800 00000020:01000000:0.0:1788639335.174306:0:21417:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae241f7b300 - data ffff9ae241830e58/ffff9ae243a70800 00100000:10000000:0.0:1788639335.189492:0:21417:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788639335.205438:0:21417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d61f 00000020:00000080:0.0:1788639335.205461:0:21417:0:(genops.c:885:class_export_put()) final put ffff9ae242269800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788639335.205520:0:21417:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae2433ef000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788639335.205524:0:21417:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae2433ef000 2 00000020:01000004:0.0:1788639335.205528:0:21417:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae2433ef000 from lustre-OST0001 00000020:00000080:0.0:1788639335.205558:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639335.205569:0:21417:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788639335.205572:0:21417:0:(genops.c:885:class_export_put()) final put ffff9ae3506ea000/lustre-OST0001_UUID 00000020:00000080:0.0:1788639335.205576:0:21417:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3506ea000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788639335.205584:0:21417:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788639335.205737:0:21417:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 4d225031-35be-4b74-b245-637fda218215->MGS 00010000:00010000:0.0:1788639335.205756:0:21417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9400/0x25c454990262d36a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d371 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639335.205770:0:21417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9400/0x25c454990262d36a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d371 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639335.205777:0:21417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788639335.205780:0:21417:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788639335.205783:0:21417:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788639335.205801:0:21417:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae2416eb000 00010000:00010000:0.0:1788639335.205805:0:21417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9400/0x25c454990262d36a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d371 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639335.205823:0:21417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639335.205830:0:21417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639335.205835:0:21417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788639335.205837:0:21417:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788639335.205839:0:21417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788639335.205861:0:21417:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae2416eb000 00010000:00010000:0.0:1788639335.205864:0:21417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788639335.205887:0:21417:0:(import.c:65:import_set_state_nolock()) ffff9ae2416eb000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788639335.205892:0:21417:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788639335.205895:0:21417:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788639335.205896:0:21417:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788639335.205901:0:21417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788639335.205915:0:21417:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae342fc1f80 x1875523773096704/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788639354 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788639335.205936:0:21417:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788639335.205940:0:21417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:2.0:1788639335.206099:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d225031-35be-4b74-b245-637fda218215:3640:1875523773096704:0@lo:250:kworker.0 10000000:01000000:0.0:1788639335.206287:0:21417:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788639335.206307:0:21417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d244 00000020:00000080:0.0:1788639335.206313:0:21417:0:(genops.c:885:class_export_put()) final put ffff9ae2416ee000/4d225031-35be-4b74-b245-637fda218215 00000020:00000080:3.0:1788639335.207029:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242269800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788639335.214522:0:21417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.118@tcp (flags='') 00000020:00000080:0.0:1788639335.214543:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639335.214554:0:21417:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.118@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788639335.214560:0:21417:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9ae3691c99c0) has no exports 10000000:01000000:2.0:1788639335.214665:0:17238:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1788639335.214820:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416ee000/4d225031-35be-4b74-b245-637fda218215 for MGC192.168.206.118@tcp 10000000:01000000:0.0:1788639335.215198:0:21417:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.118@tcp: client import never connected 00000100:00080000:0.0:1788639335.215203:0:21417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788639335.215208:0:21417:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788639335.215213:0:21417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788639335.215216:0:21417:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788639335.215281:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639335.215299:0:21417:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.118@tcp (uuid 4d225031-35be-4b74-b245-637fda218215) 00000020:01000000:0.0:1788639335.215308:0:21417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788639335.215312:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639335.215317:0:21417:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788639335.215325:0:21417:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ae24226b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788639335.215330:0:21417:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9ae36cf08000) has exports, disconnecting them 00000020:00080000:0.0:1788639335.215353:0:21417:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ae24226b800), last request at 1788639266 00000020:00000080:0.0:1788639335.215360:0:21417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d649 00000020:00080000:0.0:1788639335.215378:0:21417:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae24226b800): rc 0 00000020:00000080:0.0:1788639335.215383:0:21417:0:(genops.c:885:class_export_put()) final put ffff9ae24226b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788639335.216063:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2416eb000 for MGC192.168.206.118@tcp 00000020:00000080:3.0:1788639335.216187:0:36:0:(genops.c:885:class_export_put()) final put ffff9ae2416e9000/4d225031-35be-4b74-b245-637fda218215 00000020:00000080:3.0:1788639335.216191:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416e9000/4d225031-35be-4b74-b245-637fda218215 for MGC192.168.206.118@tcp 00000020:01000000:3.0:1788639335.216198:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.118@tcp (4d225031-35be-4b74-b245-637fda218215) 00000020:00000080:3.0:1788639335.216689:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae24226b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788639335.219171:0:21417:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788639335.219181:0:21417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788639335.219187:0:21417:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788639335.219197:0:21417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788639335.219448:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639335.219459:0:21417:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788639335.219483:0:21417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788639335.219488:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788639335.219493:0:21417:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788639335.219502:0:21417:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9ae24226e000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788639335.219510:0:21417:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9ae37724cd40) has exports, disconnecting them 00000020:00080000:2.0:1788639335.219515:0:21417:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9ae24226e000), last request at 1788639266 00000020:00000080:2.0:1788639335.219520:0:21417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d65e 00000020:00080000:2.0:1788639335.219538:0:21417:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae24226e000): rc 0 00000020:00000080:2.0:1788639335.219545:0:21417:0:(genops.c:885:class_export_put()) final put ffff9ae24226e000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788639335.220834:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae242d36800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788639335.220850:0:36:0:(genops.c:885:class_export_put()) final put ffff9ae242d32800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788639335.220854:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242d32800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788639335.220862:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788639335.220949:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae24226e000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788639335.220984:0:21417:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788639335.220988:0:21417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788639335.220992:0:21417:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788639335.220998:0:21417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788639335.221022:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae242268000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788639335.221072:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788639335.221189:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788639335.221282:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788639335.221413:0:17224:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ae2438c2c00:17224] 0 exiting: rc = 1 00000100:00100000:1.0:1788639335.227286:0:17225:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ae2438c3c00:17225] 1 exiting: rc = 0 00000100:00100000:3.0:1788639335.227758:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228129:0:17227:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ae2438c3a00:17227] 1 exiting: rc = 0 00000100:00100000:3.0:1788639335.228257:0:17226:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ae2438c3200:17226] 0 exiting: rc = 1 00000100:00100000:3.0:1788639335.228336:0:21013:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ae36dee0600:21013] 3 exiting: rc = 0 00000100:00100000:3.0:1788639335.228413:0:17228:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ae2438c2800:17228] 2 exiting: rc = 0 00000100:00100000:3.0:1788639335.228464:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228472:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228478:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228487:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228494:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228501:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228508:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228514:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228519:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228525:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228531:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228537:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228545:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228551:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228557:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228563:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228569:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228575:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228581:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228587:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228592:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228598:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228603:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228609:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228631:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228638:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228644:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228650:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228655:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228661:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228666:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228681:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228687:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228692:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228697:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228702:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228707:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228713:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228718:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228723:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228728:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228734:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228745:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.228750:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229181:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229193:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229199:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229204:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229210:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229216:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229222:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229227:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229232:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229238:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229244:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229250:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229256:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229261:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229268:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229273:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229278:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229284:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229301:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.229308:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788639335.231263:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639335.231279:0:21417:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788639335.231312:0:21417:0:(genops.c:885:class_export_put()) final put ffff9ae24226d000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788639335.231317:0:21417:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae24226d000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788639335.231326:0:21417:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788639335.231394:0:21417:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae2433ef000 1 00000020:00000080:3.0:1788639335.231403:0:21417:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262d603 00000020:00000080:3.0:1788639335.231410:0:21417:0:(genops.c:885:class_export_put()) final put ffff9ae36d08e800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788639335.231431:0:21417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788639335.231451:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d08e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788639335.231469:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639335.231475:0:21417:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788639335.231479:0:21417:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9ae36cf0cd40) has no exports 00000020:00000080:3.0:1788639335.298049:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639335.298082:0:21417:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788639335.298090:0:21417:0:(genops.c:885:class_export_put()) final put ffff9ae2433e8000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788639335.298096:0:21417:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2433e8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788639335.298113:0:21417:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788639335.298530:0:21417:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ae2433ea000 00000020:01000000:3.0:1788639335.298566:0:21417:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788639335.298571:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639335.298576:0:21417:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788639335.298581:0:21417:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9ae377248000) has no exports 00000020:00000080:3.0:1788639335.298613:0:21417:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639335.298640:0:21417:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788639335.298645:0:21417:0:(genops.c:885:class_export_put()) final put ffff9ae3490b3000/OSS_uuid 00000020:00000080:3.0:1788639335.298647:0:21417:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3490b3000/OSS_uuid for OSS 00000020:01000000:3.0:1788639335.298651:0:21417:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788639335.298735:0:18747:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ae36ce50c00:18747] 0 exiting: rc = 1 00000100:00080000:0.0:1788639335.298820:0:17237:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788639335.299494:0:19077:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ae375d12200:19077] 3 exiting: rc = 0 00000100:00100000:0.0:1788639335.299609:0:18749:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ae36ce84400:18749] 1 exiting: rc = 0 00000100:00100000:0.0:1788639335.299773:0:18750:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ae36ce85600:18750] 2 exiting: rc = 0 00000100:00100000:3.0:1788639335.299928:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.299940:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.299946:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.299953:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300032:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300053:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300059:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300068:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300075:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300082:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300088:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300094:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300100:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300107:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300113:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300119:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300125:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300132:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300180:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300188:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300193:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300198:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300204:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300209:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300215:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300221:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300226:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300232:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300238:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300243:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300248:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300253:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300259:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300265:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300270:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300275:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300282:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300484:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300495:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300502:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300530:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300537:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300543:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300548:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300553:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300559:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300736:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300742:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300747:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300753:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300759:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300765:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300771:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300777:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300786:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300792:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300878:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300885:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300891:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300897:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300902:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300908:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300914:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.300921:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.302827:0:18751:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ae36ce85200:18751] 0 exiting: rc = 1 00000100:00100000:1.0:1788639335.302843:0:20726:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9ae37490f200:20726] 2 exiting: rc = 0 00000100:00100000:2.0:1788639335.304108:0:18752:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ae36ce85e00:18752] 1 exiting: rc = 0 00000100:00100000:3.0:1788639335.304381:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304388:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304394:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304400:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304406:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304411:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304416:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304421:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304427:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304432:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304437:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304458:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304464:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304469:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304474:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304489:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304511:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304518:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304526:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304532:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304537:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304542:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304548:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304554:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304559:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304564:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304586:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304593:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304599:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304605:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.304611:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305094:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305102:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305108:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305114:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305120:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305126:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305132:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305138:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305416:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305425:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305430:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305435:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305441:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305447:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305452:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305466:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305472:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305478:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305484:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305489:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305495:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305506:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305512:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305518:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305524:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305529:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305535:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305540:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305546:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305551:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305556:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305566:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639335.305573:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639335.311406:0:18754:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ae36940e000:18754] 1 exiting: rc = 0 00000100:00100000:1.0:1788639335.311529:0:20381:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9ae369536800:20381] 3 exiting: rc = 0 00000100:00100000:2.0:1788639335.312585:0:18753:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ae3691a7400:18753] 0 exiting: rc = 1 00000100:00100000:2.0:1788639335.319181:0:18755:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ae242304e00:18755] 2 exiting: rc = 0 00000100:00100000:0.0:1788639335.319398:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319408:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319414:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319421:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319426:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319431:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319438:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319444:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319449:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319456:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319463:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319494:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319501:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319508:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319514:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319520:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319526:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319533:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319539:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319546:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319551:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319558:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319564:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319571:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319591:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319597:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319603:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319610:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319665:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319673:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319679:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319686:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319692:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319698:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319705:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319729:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319736:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319742:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319748:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319757:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319764:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319770:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319777:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319783:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319789:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319806:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319812:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319818:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319824:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319830:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319836:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319842:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319848:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319856:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319863:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319870:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319877:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319883:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319889:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319903:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319909:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319925:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319940:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.319954:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.328331:0:18757:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ae242305600:18757] 1 exiting: rc = 0 00000100:00100000:2.0:1788639335.328534:0:18756:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ae36940fe00:18756] 0 exiting: rc = 1 00000100:00100000:0.0:1788639335.328783:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328805:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328817:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328829:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328838:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328848:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328859:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328869:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328878:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328888:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328899:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328910:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328920:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328930:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328943:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.328955:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329231:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329240:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329253:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329264:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329273:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329281:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329287:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329304:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329310:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329316:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329322:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329328:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329333:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329338:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329364:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329369:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329375:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329381:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329387:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329393:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329399:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329404:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329410:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329416:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329422:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329428:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329434:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329440:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329446:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329451:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329456:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329461:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329467:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329472:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329478:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329484:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329490:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329495:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329501:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329507:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329513:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329519:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329525:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329530:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329535:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329544:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329554:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.329562:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639335.331252:0:18758:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ae36ceaea00:18758] 0 exiting: rc = 1 00000100:00100000:2.0:1788639335.331449:0:18759:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ae36ceaf200:18759] 1 exiting: rc = 0 00000100:00100000:1.0:1788639335.331596:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.331605:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332449:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332458:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332464:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332471:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332478:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332505:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332512:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332519:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332527:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332537:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332546:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332554:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332563:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332574:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332582:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332593:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332600:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332638:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332647:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332654:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332661:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332667:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332674:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332681:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332687:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332694:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332700:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332707:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332714:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332741:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332752:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332761:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332771:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332784:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332859:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332881:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332893:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332900:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332907:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332913:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332919:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332943:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.332951:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333019:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333030:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333037:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333044:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333051:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333058:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333064:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333070:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333077:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333083:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333105:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333230:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333238:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333244:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333252:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333258:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333265:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333272:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639335.333287:0:21417:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788639335.345079:0:21417:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788639353.845745:0:22182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788639362.792721:0:22781:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788639362.792726:0:22781:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788639362.792727:0:22781:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788639362.792836:0:22781:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae36cf54000 00000020:01000004:3.0:1788639362.792850:0:22781:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788639362.792856:0:22781:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788639362.792868:0:22781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ae37724cd40) 00000020:00000080:3.0:1788639362.792879:0:22781:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788639362.902214:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788639362.908363:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788639362.909457:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.919393:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.919591:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.920349:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.923459:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.924208:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.924559:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.925184:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.925815:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.926801:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.927224:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.927445:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.928238:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.929393:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.929731:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.933747:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.934264:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.934609:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.935119:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.935327:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.935578:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.935834:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.936209:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.936445:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.936672:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.936966:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.937266:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.937501:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788639362.937775:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.938080:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.938333:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.938551:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.938802:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788639362.940067:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788639362.940502:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.940759:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.941114:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.941353:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788639362.941573:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788639362.941959:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788639362.942255:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.942440:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.942649:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788639362.942856:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788639362.943169:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.944136:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.945244:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.945829:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.946342:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.946536:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788639362.946838:0:22781:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1788639362.947608:0:22781:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788639362.947932:0:22781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788639362.947939:0:22781:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788639362.947949:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262dab7 00000020:01000004:3.0:1788639362.947955:0:22781:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788639362.947960:0:22781:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788639362.947965:0:22781:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae36cf54000 from MGS 00000020:01000004:3.0:1788639362.947968:0:22781:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788639362.947978:0:22781:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ae377248000) 00000020:00000080:3.0:1788639362.947987:0:22781:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788639362.948043:0:22781:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae36cf54000 from MGS, refs=2 00080000:01000000:3.0:1788639362.948055:0:22781:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788639362.948060:0:22781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262dac5 00000100:00100000:3.0:1788639362.948159:0:22781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788639362.948287:0:22781:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788639362.948292:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788639362.949067:0:22781:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788639362.949076:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788639362.950081:0:22781:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788639362.950258:0:22781:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788639362.950264:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788639362.951124:0:22781:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788639362.951132:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788639362.951528:0:22781:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788639362.951535:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788639362.952209:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639362.952213:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639362.952214:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639362.952509:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639362.952511:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639362.952513:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639362.953123:0:22781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:2.0:1788639362.957778:0:22781:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:3.0:1788639362.958509:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788639362.958860:0:22793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788639362.958976:0:22781:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788639362.959017:0:22781:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788639362.959677:0:22781:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788639362.960159:0:22781:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788639362.960308:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788639362.960314:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788639362.962152:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788639362.962163:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788639362.962909:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788639362.962916:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788639362.963774:0:22798:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788639362.964167:0:22781:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788639362.964185:0:22781:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.118@tcp' 00000020:01000004:3.0:1788639362.964186:0:22781:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788639362.964213:0:22781:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.118@tcp (typ=mgc) 00000020:00000080:3.0:1788639362.964224:0:22781:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.118@tcp (ffff9ae37724b380) 00000020:00000080:3.0:1788639362.964237:0:22781:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788639362.964307:0:22781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae24338f800@MGC192.168.206.118@tcp: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788639362.964441:0:22781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.118@tcp-0 is initialized 00000040:01000000:3.0:1788639362.964446:0:22781:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788639362.965576:0:22799:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788639362.965990:0:22781:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.118@tcp (uuid a452a6f1-70bc-4918-a445-81111879f6e1) 00000020:00000080:3.0:1788639362.966559:0:22781:0:(genops.c:1385:class_connect()) connect: client a452a6f1-70bc-4918-a445-81111879f6e1, cookie 0x25c454990262dad3 00000100:00080000:3.0:1788639362.966571:0:22781:0:(import.c:545:import_select_connection()) MGC192.168.206.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788639362.966578:0:22781:0:(import.c:665:import_select_connection()) MGC192.168.206.118@tcp: import ffff9ae24338f800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639362.966610:0:22781:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc2300 x1875523773096832/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639362.966788:0:22781:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a452a6f1-70bc-4918-a445-81111879f6e1->MGS 00000020:01000004:3.0:1788639362.966868:0:22781:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:2.0:1788639362.967020:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a452a6f1-70bc-4918-a445-81111879f6e1:3640:1875523773096832:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788639362.967083:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788639362.967179:0:22781:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788639362.967192:0:22781:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ae3772499c0) 00000020:00000080:3.0:1788639362.967204:0:22781:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788639362.968544:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773096832 00000100:00100000:0.0:1788639362.968554:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773096832 00000100:00100000:0.0:1788639362.968592:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788639362.968601:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875523773096832:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788639362.968640:0:22794:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a452a6f1-70bc-4918-a445-81111879f6e1@0@lo t0 exp 0000000000000000 cur 621 last 0 00000020:00000080:0.0:1788639362.968733:0:22794:0:(genops.c:1385:class_connect()) connect: client a452a6f1-70bc-4918-a445-81111879f6e1, cookie 0x25c454990262dae1 00000100:00080000:0.0:1788639362.968851:0:22794:0:(import.c:65:import_set_state_nolock()) ffff9ae374826800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788639362.968922:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+5:3640:x1875523773096832:12345-0@lo:250:mount.lustre.0 Request processed in 321us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639362.968930:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788639362.968985:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788639362.968994:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.118@tcp: connect to target with instance 0 00000100:00080000:0.0:1788639362.969001:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788639362.969005:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788639362.969008:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae24338f800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788639362.969010:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788639362.969019:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788639362.969024:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a452a6f1-70bc-4918-a445-81111879f6e1:3640:1875523773096832:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788639362.979970:0:22781:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788639362.980173:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788639362.980179:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788639362.985497:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788639362.985512:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788639362.986155:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788639362.986162:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788639362.987519:0:22781:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788639362.987928:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788639362.987935:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788639362.988461:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788639362.988469:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788639363.018247:0:22781:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788639363.018425:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788639363.018430:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788639363.019596:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788639363.019605:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788639363.020283:0:22781:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788639363.020441:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788639363.020446:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788639363.020953:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788639363.020960:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788639363.021509:0:22781:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788639363.021803:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788639363.021808:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788639363.022231:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788639363.022237:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788639363.022856:0:22781:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788639363.023007:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788639363.023012:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788639363.023465:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788639363.023470:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788639363.045993:0:22781:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788639363.046198:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788639363.046205:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788639363.047752:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788639363.047763:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788639363.048793:0:22781:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788639363.048802:0:22781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788639363.049864:0:22781:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788639363.049962:0:22781:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788639363.049969:0:22781:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788639363.050063:0:22781:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788639363.050096:0:22781:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.118@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788639363.050101:0:22781:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788639363.050103:0:22781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788639363.050104:0:22781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639363.050106:0:22781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639363.050107:0:22781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639363.050108:0:22781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639363.050109:0:22781:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788639363.050111:0:22781:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788639363.050115:0:22781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639363.050116:0:22781:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788639363.050119:0:22781:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788639363.050121:0:22781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788639363.050122:0:22781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788639363.050123:0:22781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639363.050124:0:22781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639363.050125:0:22781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639363.050125:0:22781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639363.050126:0:22781:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788639363.050127:0:22781:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788639363.050128:0:22781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639363.050129:0:22781:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788639363.050165:0:22781:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788639363.050184:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773096960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788639363.050400:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639363.050479:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae346bf7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788639363.050534:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773096960 00000100:00100000:3.0:1788639363.050541:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773096960 00000100:00100000:3.0:1788639363.050749:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788639363.050763:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+5:22781:x1875523773096960:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788639363.050812:0:22796:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788639363.050815:0:22796:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788639363.050818:0:22796:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788639363.051259:0:22818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788639363.051766:0:22796:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1788639363.053803:0:22819:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788639363.053811:0:22819:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788639363.053814:0:22819:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788639363.053817:0:22819:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788639363.054053:0:22819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788639363.054260:0:22796:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788639363.054269:0:22796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788639363.056399:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+5:22781:x1875523773096960:12345-0@lo:253:mount.lustre.0 Request processed in 5632us (5991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639363.056413:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788639363.056501:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773096960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788639363.056516:0:22781:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788639363.056519:0:22781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788639363.056521:0:22781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788639363.056522:0:22781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639363.056523:0:22781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639363.056524:0:22781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639363.056526:0:22781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639363.056527:0:22781:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788639363.056529:0:22781:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788639363.056530:0:22781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639363.056532:0:22781:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788639363.056550:0:22781:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae36cf54000 from lustre-MDT0000 10000000:01000000:0.0:1788639363.056578:0:22781:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788639363.056580:0:22781:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788639363.056584:0:22781:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ae37724b380 10000000:01000000:0.0:1788639363.056590:0:22781:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788639363.056598:0:22781:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae37724b380 from 1 10000000:01000000:0.0:1788639363.056601:0:22781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788639363.057009:0:22781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.057025:0:22781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.057036:0:22781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639363.057056:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788639363.057094:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639363.057131:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35872f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788639363.057196:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773097088 00000100:00100000:0.0:1788639363.057203:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773097088 00000100:00100000:0.0:1788639363.057271:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788639363.057281:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+5:22781:x1875523773097088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639363.057292:0:22795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639363.057307:0:22795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3748ddc00/0x25c454990262daef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dae8 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639363.057327:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3748ddc00/0x25c454990262daef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dae8 expref: 6 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639363.057337:0:22795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3748ddc00/0x25c454990262daef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dae8 expref: 6 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639363.057345:0:22795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748ddc00, rc 0) 00000100:00100000:0.0:1788639363.057385:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+6:22781:x1875523773097088:12345-0@lo:101:mount.lustre.0 Request processed in 106us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639363.057391:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788639363.057449:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639363.057463:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.057472:0:22781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639363.057522:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639363.057546:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639363.057638:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35872f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788639363.057750:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773097216 00000100:00100000:3.0:1788639363.057755:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773097216 00000100:00100000:3.0:1788639363.057776:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788639363.057783:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+6:22781:x1875523773097216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639363.057857:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+6:22781:x1875523773097216:12345-0@lo:501:mount.lustre.0 Request processed in 74us (310us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788639363.057864:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788639363.057968:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097216:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788639363.057993:0:22781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788639363.058006:0:22781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.058014:0:22781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639363.058033:0:22781:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae36cf54000 10000000:01000000:1.0:1788639363.058038:0:22781:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788639363.058042:0:22781:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ae36cf54000 10000000:01000000:1.0:1788639363.058044:0:22781:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788639363.058047:0:22781:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ae36cf54000 from 1 10000000:01000000:1.0:1788639363.058049:0:22781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788639363.058067:0:22781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9800/0x25c454990262daf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.058074:0:22781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9800/0x25c454990262daf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.058081:0:22781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9800/0x25c454990262daf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639363.058094:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788639363.058118:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639363.058134:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35872f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788639363.058190:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773097344 00000100:00100000:3.0:1788639363.058194:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773097344 00000100:00100000:3.0:1788639363.058209:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788639363.058215:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+6:22781:x1875523773097344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639363.058222:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639363.058233:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f9e600/0x25c454990262dafd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262daf6 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.058247:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f9e600/0x25c454990262dafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262daf6 expref: 7 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.058256:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f9e600/0x25c454990262dafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262daf6 expref: 7 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.058263:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9e600, rc 0) 00000100:00100000:3.0:1788639363.058298:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+7:22781:x1875523773097344:12345-0@lo:101:mount.lustre.0 Request processed in 83us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639363.058304:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788639363.058367:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639363.058378:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9800/0x25c454990262daf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dafd expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.058385:0:22781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9800/0x25c454990262daf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dafd expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639363.058396:0:22781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788639363.058400:0:22781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9800/0x25c454990262daf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dafd expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.058413:0:22781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9800/0x25c454990262daf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dafd expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639363.058419:0:22781:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788639363.058422:0:22781:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788639363.058426:0:22781:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ae36cf54000 10000000:01000000:1.0:1788639363.058429:0:22781:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788639363.058431:0:22781:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788639363.058433:0:22781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788639363.058447:0:22781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8200/0x25c454990262db04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.058454:0:22781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8200/0x25c454990262db04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.058461:0:22781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8200/0x25c454990262db04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639363.058472:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788639363.058498:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639363.058519:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35872f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788639363.058575:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773097472 00000100:00100000:2.0:1788639363.058581:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773097472 00000100:00100000:2.0:1788639363.058602:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788639363.058608:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+7:22781:x1875523773097472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639363.058642:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639363.058662:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23c00/0x25c454990262db0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262db04 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.058676:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23c00/0x25c454990262db0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262db04 expref: 8 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.058684:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23c00/0x25c454990262db0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262db04 expref: 8 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.058690:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23c00, rc 0) 00000100:00100000:2.0:1788639363.058722:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+8:22781:x1875523773097472:12345-0@lo:101:mount.lustre.0 Request processed in 114us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639363.058728:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788639363.058864:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639363.058886:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8200/0x25c454990262db04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262db0b expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.058894:0:22781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8200/0x25c454990262db04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262db0b expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639363.058948:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639363.058974:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639363.058992:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35872f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788639363.059105:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773097600 00000100:00100000:2.0:1788639363.059110:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773097600 00000100:00100000:2.0:1788639363.059126:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788639363.059131:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+8:22781:x1875523773097600:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639363.059255:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+9:22781:x1875523773097600:12345-0@lo:501:mount.lustre.0 Request processed in 123us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639363.059262:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788639363.059426:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639363.059450:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639363.059485:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639363.059509:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35872f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788639363.059546:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773097728 00000100:00100000:2.0:1788639363.059556:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773097728 00000100:00100000:2.0:1788639363.059582:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788639363.059588:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+9:22781:x1875523773097728:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639363.060318:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+9:22781:x1875523773097728:12345-0@lo:503:mount.lustre.0 Request processed in 726us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639363.060326:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788639363.060422:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773097728:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639363.060956:0:22820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22820:1875523773097856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639363.060997:0:22820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639363.061029:0:22820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2430efe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788639363.061077:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773097856 00000100:00100000:1.0:1788639363.061081:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773097856 00000100:00100000:1.0:1788639363.061105:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788639363.061111:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+9:22820:x1875523773097856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639363.061571:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+9:22820:x1875523773097856:12345-0@lo:502:llog_process_th.0 Request processed in 458us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639363.061578:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788639363.061779:0:22820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22820:1875523773097856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639363.061800:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639363.061810:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.061812:0:22820:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788639363.061818:0:22820:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788639363.061820:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788639363.061835:0:22820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ae375c58000) 00000020:00000080:3.0:1788639363.061851:0:22820:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788639363.061856:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788639363.062016:0:22820:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788639363.062023:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262db19 00000020:00000080:3.0:1788639363.062210:0:22820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788639363.062214:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639363.062217:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.062219:0:22820:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788639363.062221:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639363.062225:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.062226:0:22820:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788639363.062229:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788639363.062237:0:22820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ae375c5b380) 00000020:00000080:3.0:1788639363.062245:0:22820:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788639363.062249:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788639363.062250:0:22820:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788639363.062253:0:22820:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788639363.062258:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788639363.062298:0:22820:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae36cf54000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788639363.062308:0:22820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ae375c599c0) 00000020:00000080:3.0:1788639363.062315:0:22820:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788639363.062366:0:22820:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788639363.062371:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262db2e 00000020:00000080:3.0:1788639363.062452:0:22820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788639363.062457:0:22820:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788639363.062464:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x25c454990262db35 00080000:01000000:3.0:1788639363.062469:0:22820:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788639363.062472:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262db3c 00010000:00010000:0.0:1788639363.174887:0:22820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788639363.175592:0:22820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1788639363.179805:0:22820:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788639363.181924:0:22820:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ae37f71b380) 00000020:00000080:1.0:1788639363.181945:0:22820:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788639363.182034:0:22820:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788639363.182043:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262db4a 00000020:00000080:3.0:1788639363.184878:0:22820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788639363.195452:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x25c454990262db51 00000020:00000080:1.0:1788639363.196043:0:22820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788639363.196054:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639363.196061:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639363.196064:0:22820:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788639363.196067:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788639363.196076:0:22820:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788639363.196078:0:22820:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788639363.196079:0:22820:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788639363.196081:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788639363.196084:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639363.196085:0:22820:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788639363.196088:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639363.196092:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639363.196094:0:22820:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788639363.196098:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788639363.196137:0:22820:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788639363.196164:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639363.196168:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639363.196169:0:22820:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788639363.196172:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639363.196175:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639363.196176:0:22820:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788639363.196179:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788639363.196183:0:22820:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:00000080:1.0:1788639363.196208:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788639363.196221:0:22820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9ae37f7199c0) 00000020:00000080:1.0:1788639363.196233:0:22820:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788639363.196238:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788639363.196286:0:22820:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788639363.196291:0:22820:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788639363.196297:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262db5f 00010000:00080000:1.0:1788639363.196324:0:22820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae2433e9000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788639363.211125:0:22820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788639363.212554:0:22820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788639363.212567:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788639363.212611:0:22820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788639363.212662:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262db66 00000100:00080000:1.0:1788639363.212672:0:22820:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788639363.212678:0:22820:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ae2433e9000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639363.212718:0:22820:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375c49180 x1875523773097984/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788639363.212743:0:22820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788639363.212793:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639363.212798:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639363.212800:0:22820:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788639363.212803:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788639363.212806:0:22820:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788639363.212808:0:22820:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788639363.212809:0:22820:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788639363.212811:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788639363.212814:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639363.212815:0:22820:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788639363.212818:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788639363.212822:0:22820:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788639363.212826:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639363.212827:0:22820:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788639363.212830:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788639363.212834:0:22820:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:1.0:1788639363.212858:0:22820:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788639363.212860:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788639363.212871:0:22820:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ae37f71cd40) 00000020:00000080:1.0:1788639363.212882:0:22820:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788639363.212886:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788639363.212938:0:22820:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788639363.212944:0:22820:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788639363.212950:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262db74 00010000:00080000:1.0:1788639363.212980:0:22820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae34b10d800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:1.0:1788639363.213191:0:22820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788639363.213844:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773097984:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788639363.213920:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639363.213991:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788639363.213998:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773098112:0@lo:400:kworker.0 00000100:00100000:2.0:1788639363.214030:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639363.214068:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773097984 00000100:00100000:2.0:1788639363.214075:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773097984 00000100:00100000:2.0:1788639363.214102:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788639363.214109:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875523773097984:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788639363.214122:0:22807:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788639363.218061:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773098112 00000100:00100000:0.0:1788639363.218074:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773098112 00000100:00100000:0.0:1788639363.218135:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639363.218162:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+9:3642:x1875523773098112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639363.218268:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+9:3642:x1875523773098112:12345-0@lo:400:kworker.0 Request processed in 125us (4236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639363.218276:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788639363.221861:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773098112:0@lo:400:kworker.0 00000040:01000000:3.0:1788639363.222529:0:22820:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788639363.222957:0:22820:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788639363.228177:0:22820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788639363.230611:0:22820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:2.0:1788639363.235514:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875523773097984:12345-0@lo:38:llog_process_th.0 Request processed in 21397us (21587us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788639363.235528:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788639363.235572:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2433e9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639363.235578:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788639363.235583:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773097984:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788639363.236230:0:22820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1788639363.241330:0:22826:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788639363.241337:0:22826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788639363.243792:0:22820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788639363.243805:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788639363.243841:0:22820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788639363.243861:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262db7b 00000100:00080000:3.0:1788639363.243884:0:22820:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788639363.243891:0:22820:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae34b10d800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639363.243928:0:22820:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc2a00 x1875523773098240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639363.243957:0:22820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788639363.244020:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639363.244024:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.244026:0:22820:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788639363.244030:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788639363.244032:0:22820:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788639363.244034:0:22820:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788639363.244036:0:22820:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788639363.244037:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788639363.244040:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.244042:0:22820:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788639363.244044:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788639363.244055:0:22820:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788639363.244058:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.244060:0:22820:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788639363.244064:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788639363.244067:0:22820:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:3.0:1788639363.244091:0:22820:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788639363.244093:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788639363.244104:0:22820:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ae375c5cd40) 00000020:00000080:3.0:1788639363.244116:0:22820:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788639363.244121:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788639363.244186:0:22820:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788639363.244191:0:22820:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788639363.244197:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262db89 00010000:00080000:3.0:1788639363.244224:0:22820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae37f752800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788639363.244418:0:22820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788639363.244477:0:22820:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788639363.244491:0:22820:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788639363.244841:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773098240:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788639363.244902:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773098240 offset 0 length 520: 4 00000040:00080000:3.0:1788639363.246945:0:22820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788639363.247169:0:22820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788639363.247280:0:22820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788639363.251506:0:22828:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788639363.251513:0:22828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788639363.255086:0:22820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788639363.255100:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788639363.255154:0:22820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788639363.255175:0:22820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262db90 00000100:00080000:3.0:1788639363.255184:0:22820:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788639363.255190:0:22820:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae37f752800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639363.255222:0:22820:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc1500 x1875523773098368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639363.255262:0:22820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788639363.255375:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639363.255379:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.255380:0:22820:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788639363.255383:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639363.255386:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.255388:0:22820:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788639363.255390:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788639363.255392:0:22820:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788639363.255394:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639363.255395:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.255397:0:22820:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788639363.255399:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639363.255401:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.255402:0:22820:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788639363.255406:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788639363.255436:0:22820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22820:1875523773098496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639363.255515:0:22820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639363.255551:0:22820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34850bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639363.255891:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773098368:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788639363.255920:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773098368 offset 0 length 520: 4 00000100:00100000:2.0:1788639363.255952:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773098496 00000100:00100000:2.0:1788639363.255962:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773098496 00000100:00100000:2.0:1788639363.256024:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788639363.256034:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+9:22820:x1875523773098496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639363.256176:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+9:22820:x1875523773098496:12345-0@lo:502:llog_process_th.0 Request processed in 143us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639363.256184:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788639363.256265:0:22820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22820:1875523773098496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639363.256294:0:22820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639363.256299:0:22820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.256301:0:22820:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788639363.256304:0:22820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788639363.256450:0:22781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788639363.256470:0:22781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788639363.256496:0:22781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8200/0x25c454990262db04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262db0b expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639363.256507:0:22781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8200/0x25c454990262db04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262db0b expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639363.256516:0:22781:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae36cf54000 from 1 10000000:01000000:0.0:1788639363.256518:0:22781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788639363.256542:0:22781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639363.256550:0:22781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639363.256559:0:22781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639363.256583:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773098624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788639363.256610:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639363.256677:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae346bb4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788639363.257114:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773098624 00000100:00100000:3.0:1788639363.257120:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773098624 00000100:00100000:3.0:1788639363.257169:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788639363.257178:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+9:22781:x1875523773098624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639363.257188:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639363.257207:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f9e000/0x25c454990262db9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262db97 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.257229:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f9e000/0x25c454990262db9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262db97 expref: 10 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.257239:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f9e000/0x25c454990262db9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262db97 expref: 10 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.257246:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9e000, rc 0) 00000100:00100000:3.0:1788639363.257292:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+10:22781:x1875523773098624:12345-0@lo:101:mount.lustre.0 Request processed in 115us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639363.257299:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788639363.257676:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773098624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639363.257692:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.257702:0:22781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639363.259509:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773098752:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788639363.259575:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639363.259611:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639363.259789:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773098752 00000100:00100000:0.0:1788639363.259804:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773098752 00000100:00100000:1.0:1788639363.260116:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788639363.260126:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+10:22781:x1875523773098752:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788639363.260165:0:22794:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788639363.260174:0:22794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788639363.260259:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+10:22781:x1875523773098752:12345-0@lo:256:mount.lustre.0 Request processed in 134us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639363.260266:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788639363.264480:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773098752:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788639363.265128:0:22781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788639363.265210:0:22781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639363.265223:0:22781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639363.265231:0:22781:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae36cf54000 from 1 10000000:01000000:0.0:1788639363.265234:0:22781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788639363.265271:0:22781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639363.265279:0:22781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639363.265288:0:22781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639363.265306:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773098880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788639363.265358:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639363.265388:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae346bb4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788639363.265653:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773098880 00000100:00100000:3.0:1788639363.265660:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773098880 00000100:00100000:3.0:1788639363.265715:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788639363.265724:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+10:22781:x1875523773098880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639363.265735:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639363.265748:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f9f600/0x25c454990262dbac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dba5 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.265768:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f9f600/0x25c454990262dbac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dba5 expref: 11 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.265778:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f9f600/0x25c454990262dbac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dba5 expref: 11 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.265798:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9f600, rc 0) 00000100:00100000:3.0:1788639363.265839:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+11:22781:x1875523773098880:12345-0@lo:101:mount.lustre.0 Request processed in 115us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639363.265859:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788639363.266253:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773098880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639363.266267:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639363.266275:0:22781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639363.266332:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773099008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639363.266359:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639363.266389:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae346bb4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788639363.266435:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773099008 00000100:00100000:3.0:1788639363.266440:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773099008 00000100:00100000:3.0:1788639363.266471:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788639363.266478:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+11:22781:x1875523773099008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639363.266608:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+11:22781:x1875523773099008:12345-0@lo:501:mount.lustre.0 Request processed in 129us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639363.266642:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788639363.266763:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773099008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639363.266790:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773099136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639363.266831:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639363.266868:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae346bb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788639363.266976:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773099136 00000100:00100000:1.0:1788639363.266980:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773099136 00000100:00100000:1.0:1788639363.267012:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788639363.267019:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+11:22781:x1875523773099136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639363.267109:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+11:22781:x1875523773099136:12345-0@lo:503:mount.lustre.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639363.267116:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788639363.267579:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773099136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639363.268195:0:22830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22830:1875523773099264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639363.268238:0:22830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639363.268271:0:22830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae346bb4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639363.268326:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773099264 00000100:00100000:1.0:1788639363.268332:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773099264 00000100:00100000:1.0:1788639363.268365:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788639363.268373:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+11:22830:x1875523773099264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639363.268883:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+11:22830:x1875523773099264:12345-0@lo:502:llog_process_th.0 Request processed in 508us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639363.268892:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788639363.268907:0:22830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22830:1875523773099264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639363.268941:0:22830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639363.268950:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.268953:0:22830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788639363.268960:0:22830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae36cf54000 00000020:00000080:3.0:1788639363.268963:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788639363.268971:0:22830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639363.268973:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.268974:0:22830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788639363.268977:0:22830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639363.268980:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.268981:0:22830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788639363.268984:0:22830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae36cf54000 00000020:00000080:3.0:1788639363.268987:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788639363.269042:0:22830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639363.269047:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.269055:0:22830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788639363.269059:0:22830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639363.269062:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.269064:0:22830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788639363.269068:0:22830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae36cf54000 00000020:00000080:3.0:1788639363.269070:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788639363.269093:0:22830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639363.269096:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.269098:0:22830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788639363.269100:0:22830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639363.269102:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.269103:0:22830:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788639363.269106:0:22830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae36cf54000 00000020:00000080:3.0:1788639363.269108:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788639363.269151:0:22830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22830:1875523773099392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639363.269190:0:22830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639363.269214:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773099392 00000100:00100000:3.0:1788639363.269219:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773099392 00000100:00100000:3.0:1788639363.269245:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788639363.269251:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+11:22830:x1875523773099392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639363.269326:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+11:22830:x1875523773099392:12345-0@lo:502:llog_process_th.0 Request processed in 75us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639363.269333:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788639363.269368:0:22830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788639363.269383:0:22830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22830:1875523773099392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639363.269400:0:22830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639363.269404:0:22830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639363.269406:0:22830:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788639363.269409:0:22830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788639363.277980:0:22781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788639363.278015:0:22781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639363.278036:0:22781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.278048:0:22781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639363.278107:0:22781:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788639363.278110:0:22781:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae36cf54000 10000000:01000000:2.0:1788639363.278113:0:22781:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae36cf54000 10000000:01000000:2.0:1788639363.278117:0:22781:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788639363.278123:0:22781:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae36cf54000 from 1 10000000:01000000:2.0:1788639363.278125:0:22781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788639363.278173:0:22781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22800/0x25c454990262dbb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.278181:0:22781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f22800/0x25c454990262dbb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.278192:0:22781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f22800/0x25c454990262dbb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639363.278215:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773099520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788639363.278286:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639363.278331:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35058a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788639363.278654:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773099520 00000100:00100000:3.0:1788639363.278661:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773099520 00000100:00100000:3.0:1788639363.278732:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788639363.278742:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+11:22781:x1875523773099520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639363.278754:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639363.278765:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f9f000/0x25c454990262dbba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dbb3 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.278786:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f9f000/0x25c454990262dbba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dbb3 expref: 12 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.278795:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f9f000/0x25c454990262dbba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dbb3 expref: 12 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.278803:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9f000, rc 0) 00000100:00100000:3.0:1788639363.278840:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+12:22781:x1875523773099520:12345-0@lo:101:mount.lustre.0 Request processed in 100us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639363.278856:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788639363.280572:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773099520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639363.280596:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f22800/0x25c454990262dbb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dbba expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.280608:0:22781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f22800/0x25c454990262dbb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dbba expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639363.280698:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773099648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639363.280748:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639363.280786:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35058a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788639363.280845:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773099648 00000100:00100000:3.0:1788639363.280914:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773099648 00000100:00100000:3.0:1788639363.280999:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788639363.281009:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+12:22781:x1875523773099648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639363.281151:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+12:22781:x1875523773099648:12345-0@lo:501:mount.lustre.0 Request processed in 134us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639363.281215:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773099648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639363.281244:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773099776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639363.281284:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639363.281304:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788639363.283431:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae346bb4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788639363.283523:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773099776 00000100:00100000:3.0:1788639363.283531:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773099776 00000100:00100000:3.0:1788639363.283564:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788639363.283571:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+12:22781:x1875523773099776:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639363.283735:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+12:22781:x1875523773099776:12345-0@lo:503:mount.lustre.0 Request processed in 164us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639363.283742:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788639363.283934:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773099776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639363.284416:0:22834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22834:1875523773099904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639363.285415:0:22834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639363.285455:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773099904 00000100:00100000:0.0:1788639363.285462:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773099904 00000100:00100000:0.0:1788639363.285494:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788639363.285504:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+12:22834:x1875523773099904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639363.285630:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+12:22834:x1875523773099904:12345-0@lo:502:llog_process_th.0 Request processed in 112us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639363.285639:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788639363.285686:0:22834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae346bb46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639363.285705:0:22834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22834:1875523773099904:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788639363.285762:0:22834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788639363.285777:0:22834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ae36cf0b380) 00000020:00000080:0.0:1788639363.285796:0:22834:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788639363.286092:0:22834:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae36cf54000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788639363.286096:0:22834:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae36cf54000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788639363.286099:0:22834:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae36cf54000 4 00010000:00080000:0.0:1788639363.286374:0:22834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae3603a9800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788639363.298996:0:22834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788639363.299206:0:22834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788639363.299246:0:22834:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788639363.299258:0:22834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x25c454990262dbc8 00000100:00080000:0.0:1788639363.299268:0:22834:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788639363.299274:0:22834:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ae3603a9800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788639363.299318:0:22834:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae3748a9c00 x1875523773100032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788639363.299353:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773100032:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788639363.299431:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788639363.299494:0:22834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788639363.301047:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773100032 00000100:00100000:3.0:1788639363.301058:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773100032 00000100:00100000:3.0:1788639363.301090:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788639363.301097:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523773100032:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788639363.301174:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523773100032:12345-0@lo:38:llog_process_th.0 Request processed in 76us (1744us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788639363.301181:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788639363.301491:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788639363.301499:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae3603a9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639363.301503:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788639363.301506:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773100032:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788639363.301608:0:22834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22834:1875523773100160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639363.301709:0:22834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639363.301731:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773100160 00000100:00100000:0.0:1788639363.301734:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773100160 00000100:00100000:0.0:1788639363.301760:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788639363.301765:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+12:22834:x1875523773100160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639363.304127:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+12:22834:x1875523773100160:12345-0@lo:502:llog_process_th.0 Request processed in 2355us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639363.304149:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788639363.304269:0:22834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3431e9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788639363.304290:0:22834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22834:1875523773100160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639363.304349:0:22834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22834:1875523773100288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639363.304399:0:22834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639363.304572:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773100288 00000100:00100000:1.0:1788639363.304580:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773100288 00000100:00100000:1.0:1788639363.304746:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788639363.304757:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+12:22834:x1875523773100288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639363.305843:0:22834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3431e9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788639363.305845:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+12:22834:x1875523773100288:12345-0@lo:502:llog_process_th.0 Request processed in 1088us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639363.305854:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788639363.306085:0:22834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a452a6f1-70bc-4918-a445-81111879f6e1:22834:1875523773100288:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788639363.306116:0:22834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788639363.306210:0:22781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788639363.306235:0:22781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788639363.306260:0:22781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22800/0x25c454990262dbb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dbba expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639363.306270:0:22781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f22800/0x25c454990262dbb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dbba expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788639363.306325:0:22781:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788639363.306327:0:22781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788639363.306329:0:22781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639363.306330:0:22781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639363.306331:0:22781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639363.306333:0:22781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639363.306334:0:22781:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788639363.306335:0:22781:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788639363.306337:0:22781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639363.306338:0:22781:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788639363.306341:0:22781:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788639363.306344:0:22781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788639363.306345:0:22781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788639363.306346:0:22781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639363.306347:0:22781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639363.306348:0:22781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639363.306349:0:22781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639363.306350:0:22781:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788639363.306351:0:22781:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788639363.306352:0:22781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639363.306353:0:22781:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788639363.306370:0:22781:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788639363.306383:0:22781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773100416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788639363.306420:0:22781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639363.306443:0:22781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3431e9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788639363.306445:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773100416 00000100:00100000:1.0:1788639363.306452:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773100416 00000100:00100000:1.0:1788639363.306547:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788639363.306558:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+12:22781:x1875523773100416:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788639363.306591:0:22794:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788639363.306604:0:22794:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788639363.314090:0:22794:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788639363.314107:0:22794:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788639363.314440:0:22818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788639363.314446:0:22818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788639363.314470:0:22818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.314488:0:22818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f9e000/0x25c454990262db9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262db97 expref: 12 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639363.314495:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+12:22781:x1875523773100416:12345-0@lo:253:mount.lustre.0 Request processed in 7936us (8070us total) trans 0 rc 0/0 00010000:00010000:1.0:1788639363.314500:0:22818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639363.314509:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788639363.314537:0:22818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f9e000/0x25c454990262db9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262db97 expref: 11 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.314553:0:22818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae242f9e000/0x25c454990262db9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262db97 expref: 11 pid: 22796 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639363.314566:0:22818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773100544:0@lo:104: 00000100:00100000:1.0:1788639363.314605:0:22818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639363.314642:0:22781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:22781:1875523773100416:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788639363.314655:0:22781:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788639363.314658:0:22781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788639363.314659:0:22781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788639363.314668:0:22781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639363.314669:0:22781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639363.314670:0:22781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639363.314671:0:22781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639363.314673:0:22781:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788639363.314674:0:22781:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788639363.314676:0:22781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639363.314677:0:22781:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788639363.314693:0:22781:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788639363.314813:0:22818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae350c4f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639363.317751:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773100544 00000100:00100000:3.0:1788639363.317763:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773100544 00000100:00100000:3.0:1788639363.317801:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788639363.317810:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a452a6f1-70bc-4918-a445-81111879f6e1+3:22818:x1875523773100544:12345-0@lo:104: 00010000:00010000:3.0:1788639363.317826:0:22785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639363.317984:0:22785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788639363.317990:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a452a6f1-70bc-4918-a445-81111879f6e1+3:22818:x1875523773100544:12345-0@lo:104: Request processed in 182us (3385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639363.317998:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788639363.318322:0:22818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773100544:0@lo:104: 00010000:00010000:1.0:1788639363.318343:0:22818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.319134:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639363.319155:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.319166:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dce00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639363.319171:0:22791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.319181:0:22791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639363.319199:0:22791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639363.319213:0:22791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788639363.319252:0:22791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.319259:0:22791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639363.319281:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.319288:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262db97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262db9e expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.319305:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639363.319307:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639363.319309:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639363.319322:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773100672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639363.319374:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639363.320758:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773100672 00000100:00100000:1.0:1788639363.320774:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773100672 00010000:00010000:1.0:1788639363.320803:0:22787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f9e000/0x25c454990262db9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262db97 expref: 12 pid: 22796 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639363.320836:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788639363.320844:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+12:3642:x1875523773100672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639363.320857:0:22787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639363.320862:0:22787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f9e000/0x25c454990262db9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262db97 expref: 12 pid: 22796 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.321026:0:22787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f9e000/0x25c454990262db9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262db97 expref: 12 pid: 22796 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.321044:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f9e000/0x25c454990262db9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262db97 expref: 12 pid: 22796 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.321062:0:22787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.321071:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788639363.321086:0:22787:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006640778s 00010000:00010000:1.0:1788639363.321090:0:22787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.321098:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.321105:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.321124:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.321130:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639363.321135:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.321158:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.321173:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639363.321184:0:22787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639363.321310:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+11:3642:x1875523773100672:12345-0@lo:103:ldlm_bl.0 Request processed in 465us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639363.321318:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788639363.321364:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773100672:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639363.321954:0:22818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.321965:0:22818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639363.321973:0:22818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2421f8000/0x25c454990262dbcf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788639363.337282:0:22781:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:0.0:1788639363.338390:0:22781:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788639363.338724:0:22842:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:3.0:1788639363.338729:0:22842:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:2.0:1788639363.338838:0:22781:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1788639363.339293:0:22844:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9ae2432c9180 x1875523773100800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000040:01000000:0.0:1788639363.339297:0:22843:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788639363.339314:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00000040:01000000:3.0:1788639363.339544:0:22781:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788639363.339579:0:22781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788639363.340228:0:22781:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788639363.340237:0:22781:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788639363.340281:0:22781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788639363.340391:0:22843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788639363.346405:0:22781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788639363.348186:0:22781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788639363.348315:0:22781:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788639363.350960:0:22843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788639363.351027:0:22843:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788639363.351336:0:22781:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788639363.352309:0:22781:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1788639363.357440:0:22781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788639363.373709:0:22781:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788639363.373744:0:22781:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaea581c67988 00100000:10000000:3.0:1788639363.373751:0:22781:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788639363.374563:0:22781:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788639363.374577:0:22781:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788639363.374597:0:22781:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788639363.374672:0:22781:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788639363.376573:0:22781:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788639363.378249:0:22781:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788639363.959145:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639364.341240:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00000040:00080000:3.0:1788639364.341352:0:22838:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788639364.341358:0:22838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639364.343366:0:22838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788639364.343377:0:22838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788639364.980791:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788639364.980888:0:22799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788639364.980894:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae36cf54000 from 11 10000000:01000000:3.0:1788639364.980901:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788639364.980969:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639364.980996:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639364.981010:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639364.981057:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773100928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639364.981160:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639364.981221:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788639364.981287:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773100928 00000100:00100000:1.0:1788639364.981297:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773100928 00000100:00100000:1.0:1788639364.981757:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788639364.981769:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+11:22799:x1875523773100928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639364.981786:0:22795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639364.981803:0:22795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f8400/0x25c454990262dbdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dbd6 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639364.981830:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f8400/0x25c454990262dbdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dbd6 expref: 12 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639364.981843:0:22795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f8400/0x25c454990262dbdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dbd6 expref: 12 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639364.981860:0:22795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8400, rc 0) 00000100:00100000:1.0:1788639364.982094:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+12:22799:x1875523773100928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 327us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639364.982102:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788639364.982188:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773100928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639364.982205:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639364.982215:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639364.982274:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773101056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788639364.982518:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639364.983800:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788639364.983845:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773101056 00000100:00100000:1.0:1788639364.983855:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773101056 00000100:00100000:1.0:1788639364.983900:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788639364.983909:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+12:22799:x1875523773101056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788639364.983934:0:22795:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788639364.984107:0:22795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788639364.984112:0:22795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788639364.984237:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+12:22799:x1875523773101056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 328us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639364.984245:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788639364.985811:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773101056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788639364.985880:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788639364.985893:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639364.985906:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639365.365192:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00000040:00080000:2.0:1788639365.365771:0:22838:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788639365.365778:0:22838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788639365.365934:0:22838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788639365.365974:0:22838:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788639365.366155:0:22838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1788639366.007098:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639366.393612:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00010000:00010000:2.0:1788639367.029051:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639367.413767:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00000001:02000400:2.0:1788639367.597733:0:23087:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788639368.052802:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788639368.374696:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788639368.374704:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788639368.374708:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae2433e9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788639368.374716:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 622 00000100:00080000:0.0:1788639368.374722:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788639368.374729:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ae2433e9000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639368.374739:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639368.374750:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae3748aad80 x1875523773101312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788639368.374754:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a452a6f1-70bc-4918-a445-81111879f6e1:3644:1875523773101184:0@lo:400:kworker.0 00000100:00080000:0.0:1788639368.374761:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788639368.374764:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788639368.374767:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788639368.374769:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788639368.374778:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788639368.374780:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788639368.374782:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae3603a9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788639368.374785:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ae3603a9800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788639368.374797:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae3748a8a80 x1875523773101440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788639368.374828:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639368.374871:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773101184 00000100:00100000:0.0:1788639368.374878:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773101184 00000100:00100000:0.0:1788639368.374917:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788639368.374927:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+12:3644:x1875523773101184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639368.374986:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+12:3644:x1875523773101184:12345-0@lo:400:kworker.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639368.374993:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788639368.375069:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a452a6f1-70bc-4918-a445-81111879f6e1:3644:1875523773101184:0@lo:400:kworker.0 00000100:00100000:2.0:1788639368.375248:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773101312:0@lo:38:kworker.0 00000100:00100000:2.0:1788639368.375280:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639368.375343:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773101440:0@lo:38:kworker.0 00000100:00100000:2.0:1788639368.375372:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639368.375474:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773101440 00000100:00100000:1.0:1788639368.375479:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773101440 00000100:00100000:1.0:1788639368.375507:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788639368.375512:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875523773101440:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788639368.375533:0:22804:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:1.0:1788639368.375731:0:22804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x25c454990262dbe4 00000004:00100000:1.0:1788639368.375745:0:22804:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788639368.375873:0:22804:0:(import.c:65:import_set_state_nolock()) ffff9ae342c42800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639368.375921:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875523773101440:12345-0@lo:38:kworker.0 Request processed in 408us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639368.375928:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788639368.376000:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae3748a8a80 x1875523773101440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788639368.376014:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788639368.376026:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788639368.376031:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788639368.376034:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae3603a9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788639368.376039:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773101440:0@lo:38:kworker.0 00000100:00100000:0.0:1788639368.376111:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773101312 00000100:00100000:0.0:1788639368.376127:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773101312 00000100:00100000:0.0:1788639368.376185:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788639368.376191:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875523773101312:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788639368.376203:0:22808:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788639368.376248:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875523773101312:12345-0@lo:38:kworker.0 Request processed in 56us (967us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788639368.376256:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788639368.376319:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2433e9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639368.376324:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788639368.376328:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773101312:0@lo:38:kworker.0 00000020:00000004:2.0:1788639368.436362:0:23139:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788639368.436572:0:23139:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788639368.439202:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00010000:00010000:0.0:1788639369.078793:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788639369.323309:0:23189:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788639369.323605:0:23189:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788639369.462441:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00010000:00010000:1.0:1788639370.102231:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639370.486093:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00010000:00010000:0.0:1788639371.143881:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639371.510208:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00010000:00010000:1.0:1788639372.149341:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639372.533149:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00010000:00010000:2.0:1788639373.177330:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639373.493636:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788639373.493642:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788639373.493646:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae2433e9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639373.493654:0:13809:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 627 00000100:00080000:3.0:1788639373.493660:0:13809:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788639373.493666:0:13809:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ae2433e9000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639373.493690:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc3480 x1875523773101696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639373.493725:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639373.493730:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639373.493733:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639373.493736:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788639373.493773:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639373.493789:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773101568:0@lo:400:kworker.0 00000100:00100000:3.0:1788639373.493908:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639373.493968:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639363/real 1788639363] req@ffff9ae342fc1500 x1875523773098368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639373 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639373.493988:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae342fc1500 x1875523773098368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639373 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639373.493997:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639363/real 1788639363] req@ffff9ae342fc2a00 x1875523773098240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639373 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639373.494008:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae342fc2a00 x1875523773098240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639373 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639373.494020:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773101696:0@lo:38:kworker.0 00000100:00100000:3.0:1788639373.494081:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788639373.494122:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae37f752800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788639373.494133:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788639373.494137:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773098368:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788639373.494142:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae34b10d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788639373.494146:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788639373.494157:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773098240:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788639373.494197:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773101824:0@lo:400:kworker.0 00000100:00100000:3.0:1788639373.494242:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639373.494276:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773101568 00000100:00100000:3.0:1788639373.494283:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773101568 00000100:00100000:3.0:1788639373.494326:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788639373.494335:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+12:3643:x1875523773101568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639373.494379:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+12:3643:x1875523773101568:12345-0@lo:400:kworker.0 Request processed in 45us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639373.494386:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788639373.494437:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773101696 00000100:00100000:3.0:1788639373.494441:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773101696 00000100:00100000:3.0:1788639373.494461:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788639373.494466:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875523773101696:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788639373.494899:0:22807:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788639373.494940:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875523773101696:12345-0@lo:38:kworker.0 Request processed in 472us (859us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788639373.494947:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788639373.494976:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773101824 00000100:00100000:3.0:1788639373.494979:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773101824 00000100:00100000:3.0:1788639373.495202:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788639373.495210:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773101824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639373.495251:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773101824:12345-0@lo:400:kworker.0 Request processed in 43us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639373.495257:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788639373.495295:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae342fc0380 x1875523773101824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639373.495318:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773101824:0@lo:400:kworker.0 00000100:00100000:3.0:1788639373.495358:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773101568:0@lo:400:kworker.0 00000100:00080000:3.0:1788639373.495375:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639373.495378:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788639373.495381:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae34b10d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639373.495385:0:13809:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 622 00000100:00080000:3.0:1788639373.495388:0:13809:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788639373.495392:0:13809:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae34b10d800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639373.495414:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc1c00 x1875523773101952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639373.495424:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639373.495427:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788639373.495429:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae37f752800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639373.495431:0:13809:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 622 00000100:00080000:3.0:1788639373.495434:0:13809:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788639373.495437:0:13809:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae37f752800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639373.495446:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc0380 x1875523773102080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788639373.495468:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773101952:0@lo:8:kworker.0 00000400:00000100:3.0:1788639373.496441:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773101952 offset 0 length 520: 4 00000100:00100000:3.0:1788639373.496475:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773102080:0@lo:8:kworker.0 00000400:00000100:3.0:1788639373.496496:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773102080 offset 0 length 520: 4 00000100:00080000:3.0:1788639373.496534:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2433e9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788639373.496539:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788639373.496542:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773101696:0@lo:38:kworker.0 00000100:00100000:0.0:1788639373.556868:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00010000:00010000:3.0:1788639374.196817:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639374.580714:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00010000:00010000:2.0:1788639375.221371:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788639375.265401:0:23534:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788639375.265405:0:23534:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788639375.265406:0:23534:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788639375.265507:0:23534:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae342c41800 00000020:01000004:1.0:1788639375.265970:0:23534:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788639375.265983:0:23534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788639375.265997:0:23534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9ae37f718000) 00000020:00000080:1.0:1788639375.266013:0:23534:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788639375.319980:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788639375.320980:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.323369:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.323821:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.324749:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.325105:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.325284:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.325466:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.325867:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.326103:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.326270:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.326461:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.326756:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.326920:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.327091:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.327251:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.327406:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.327881:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.328092:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.328275:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.328496:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.328943:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.329163:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.329380:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.329709:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.329885:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.330217:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.330410:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.330598:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.331123:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.331344:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788639375.331573:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.331865:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.332098:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788639375.332892:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788639375.333254:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788639375.333448:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788639375.333737:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788639375.333965:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788639375.334273:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788639375.334469:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788639375.334726:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788639375.334912:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788639375.335750:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788639375.336173:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788639375.336727:0:23534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1788639375.341359:0:23534:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788639375.341813:0:23534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788639375.341826:0:23534:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788639375.341838:0:23534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262dbf2 00000020:01000004:1.0:1788639375.341845:0:23534:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788639375.341863:0:23534:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788639375.341866:0:23534:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788639375.341872:0:23534:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788639375.341895:0:23534:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788639375.341899:0:23534:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788639375.345674:0:23534:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788639375.345712:0:23534:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.118@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788639375.345716:0:23534:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788639375.345718:0:23534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788639375.345720:0:23534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639375.345721:0:23534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639375.345723:0:23534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639375.345724:0:23534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639375.345725:0:23534:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788639375.345730:0:23534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639375.345731:0:23534:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788639375.345735:0:23534:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788639375.345737:0:23534:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788639375.345738:0:23534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788639375.345739:0:23534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639375.345740:0:23534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639375.345740:0:23534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639375.345742:0:23534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639375.345742:0:23534:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788639375.345743:0:23534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639375.345744:0:23534:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788639375.345770:0:23534:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788639375.345788:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102208:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788639375.345853:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.345959:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788639375.346011:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773102208 00000100:00100000:2.0:1788639375.346019:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773102208 00000100:00100000:2.0:1788639375.346132:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788639375.346143:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+12:23534:x1875523773102208:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788639375.346172:0:22796:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788639375.346175:0:22796:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788639375.346181:0:22796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788639375.346524:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+12:23534:x1875523773102208:12345-0@lo:253:mount.lustre.0 Request processed in 382us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639375.346532:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788639375.346657:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102208:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788639375.346669:0:23534:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788639375.346671:0:23534:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788639375.346672:0:23534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788639375.346673:0:23534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639375.346675:0:23534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639375.346676:0:23534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639375.346680:0:23534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639375.346682:0:23534:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788639375.346683:0:23534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639375.346684:0:23534:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788639375.346701:0:23534:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae342c41800 from lustre-MDT0001 10000000:01000000:1.0:1788639375.346723:0:23534:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788639375.346726:0:23534:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788639375.346732:0:23534:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae37724b380 local copy 00010000:00010000:1.0:1788639375.346740:0:23534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639375.346832:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639375.346868:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.347360:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788639375.347425:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773102336 00000100:00100000:3.0:1788639375.347431:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773102336 00000100:00100000:3.0:1788639375.347462:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788639375.347468:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+12:23534:x1875523773102336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639375.347613:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102336:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788639375.347648:0:23534:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788639375.347666:0:23534:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788639375.347673:0:23534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.347682:0:23534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639375.347706:0:23534:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae342c41800 10000000:01000000:1.0:1788639375.347711:0:23534:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788639375.347715:0:23534:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ae37724b380 10000000:01000000:1.0:1788639375.347717:0:23534:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788639375.347721:0:23534:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ae37724b380 from 1 10000000:01000000:1.0:1788639375.347724:0:23534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788639375.347747:0:23534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262dbf9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.347754:0:23534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262dbf9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.347763:0:23534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262dbf9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639375.347776:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788639375.347802:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.347827:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639375.347928:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773102464 00000100:00100000:2.0:1788639375.347932:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773102464 00000100:00100000:2.0:1788639375.347954:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788639375.347961:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+13:23534:x1875523773102464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639375.347970:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639375.347982:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f22c00/0x25c454990262dc00 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dbf9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639375.348008:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f22c00/0x25c454990262dc00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dbf9 expref: 14 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639375.348026:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f22c00/0x25c454990262dc00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dbf9 expref: 14 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639375.348034:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22c00, rc 0) 00000100:00100000:2.0:1788639375.348074:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+14:23534:x1875523773102464:12345-0@lo:101:mount.lustre.0 Request processed in 114us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639375.348092:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788639375.348213:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639375.348226:0:23534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262dbf9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dc00 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.348234:0:23534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262dbf9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dc00 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639375.348251:0:23534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788639375.348268:0:23534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262dbf9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dc00 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.348277:0:23534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262dbf9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dc00 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639375.348284:0:23534:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ae342c41800 10000000:01000000:1.0:1788639375.348287:0:23534:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788639375.348290:0:23534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ae342c41800 from 1 10000000:01000000:1.0:1788639375.348293:0:23534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788639375.348312:0:23534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8e00/0x25c454990262dc07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639375.348319:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+13:23534:x1875523773102336:12345-0@lo:501:mount.lustre.0 Request processed in 851us (1450us total) trans 0 rc -2/-2 00010000:00010000:1.0:1788639375.348319:0:23534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8e00/0x25c454990262dc07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.348326:0:23534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8e00/0x25c454990262dc07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639375.348327:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788639375.348338:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788639375.348362:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.348398:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788639375.348443:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773102592 00000100:00100000:3.0:1788639375.348447:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773102592 00000100:00100000:3.0:1788639375.348479:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788639375.348485:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+13:23534:x1875523773102592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639375.348492:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639375.348501:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f9ec00/0x25c454990262dc0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dc07 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.348514:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f9ec00/0x25c454990262dc0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dc07 expref: 14 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.348522:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f9ec00/0x25c454990262dc0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dc07 expref: 14 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.348529:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9ec00, rc 0) 00000100:00100000:3.0:1788639375.348809:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+14:23534:x1875523773102592:12345-0@lo:101:mount.lustre.0 Request processed in 323us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639375.348826:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788639375.349133:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639375.349147:0:23534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8e00/0x25c454990262dc07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dc0e expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.349237:0:23534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8e00/0x25c454990262dc07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dc0e expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639375.349251:0:23534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788639375.349311:0:23534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8e00/0x25c454990262dc07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dc0e expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.349320:0:23534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8e00/0x25c454990262dc07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dc0e expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639375.349327:0:23534:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788639375.349331:0:23534:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788639375.349336:0:23534:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ae342c41800 10000000:01000000:1.0:1788639375.349339:0:23534:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788639375.349343:0:23534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788639375.349345:0:23534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788639375.349364:0:23534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262dc15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.349372:0:23534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262dc15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.349379:0:23534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262dc15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639375.349408:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788639375.349438:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.349472:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788639375.349525:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773102720 00000100:00100000:3.0:1788639375.349531:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773102720 00000100:00100000:3.0:1788639375.349590:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788639375.349599:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+14:23534:x1875523773102720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639375.349608:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639375.349645:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f9e400/0x25c454990262dc1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dc15 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.349662:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f9e400/0x25c454990262dc1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dc15 expref: 15 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.349671:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f9e400/0x25c454990262dc1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dc15 expref: 15 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.349678:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9e400, rc 0) 00000100:00100000:3.0:1788639375.349714:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+15:23534:x1875523773102720:12345-0@lo:101:mount.lustre.0 Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639375.349720:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788639375.349806:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639375.349818:0:23534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262dc15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dc1c expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.349826:0:23534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262dc15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dc1c expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788639375.351711:0:23534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1788639375.352228:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788639375.359550:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788639375.359606:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788639375.359649:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788639375.359665:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788639375.359681:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788639375.359694:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788639375.359708:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788639375.359723:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788639375.359735:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788639375.359747:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788639375.359760:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788639375.359773:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788639375.359785:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788639375.359798:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788639375.359812:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788639375.359828:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788639375.359842:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788639375.359869:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788639375.359883:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788639375.359897:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788639375.359911:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788639375.359924:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788639375.359937:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788639375.359951:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788639375.359963:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1788639375.359976:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1788639375.359989:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1788639375.360002:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1788639375.360014:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1788639375.360027:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1788639375.360041:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1788639375.360054:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1788639375.360067:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1788639375.360095:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1788639375.360110:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1788639375.360122:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1788639375.360135:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1788639375.360147:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1788639375.360249:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1788639375.360266:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1788639375.360281:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1788639375.360296:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1788639375.360311:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1788639375.360324:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1788639375.360353:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1788639375.360359:0:23534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1788639375.360456:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639375.360517:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.360566:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788639375.360670:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773102848 00000100:00100000:0.0:1788639375.360678:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773102848 00000100:00100000:0.0:1788639375.360777:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788639375.360786:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+15:23534:x1875523773102848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639375.360965:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+15:23534:x1875523773102848:12345-0@lo:501:mount.lustre.0 Request processed in 180us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639375.360973:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788639375.361065:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639375.361108:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639375.361149:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639375.361433:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773102976 00000100:00100000:3.0:1788639375.361438:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773102976 00000100:00100000:3.0:1788639375.361465:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788639375.361472:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+15:23534:x1875523773102976:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639375.361656:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788639375.363059:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+15:23534:x1875523773102976:12345-0@lo:503:mount.lustre.0 Request processed in 1581us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639375.363072:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788639375.363187:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773102976:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788639375.363996:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788639375.364091:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773103104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639375.364143:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.364224:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788639375.364262:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773103104 00000100:00100000:0.0:1788639375.364269:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773103104 00000100:00100000:0.0:1788639375.364315:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788639375.364325:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+15:23534:x1875523773103104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639375.365715:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+15:23534:x1875523773103104:12345-0@lo:502:mount.lustre.0 Request processed in 1386us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639375.365727:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788639375.365891:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773103104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639375.366132:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788639375.366163:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1788639375.366177:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1788639375.366189:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1788639375.366201:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1788639375.366214:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1788639375.366227:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1788639375.366242:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1788639375.366255:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1788639375.366268:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1788639375.366280:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1788639375.366292:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1788639375.366304:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1788639375.366317:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1788639375.366331:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1788639375.366345:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1788639375.366358:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1788639375.366372:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1788639375.366385:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1788639375.366409:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1788639375.366423:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1788639375.366436:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1788639375.366449:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1788639375.366464:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1788639375.366478:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1788639375.366490:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1788639375.366502:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1788639375.366516:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1788639375.366529:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1788639375.366545:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1788639375.366559:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1788639375.366573:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1788639375.366587:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1788639375.366600:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1788639375.366612:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1788639375.366671:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1788639375.366687:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1788639375.366701:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1788639375.366716:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1788639375.366729:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1788639375.366744:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1788639375.366758:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1788639375.366770:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1788639375.366783:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1788639375.366816:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773103232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639375.366870:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.366974:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788639375.368735:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773103232 00000100:00100000:3.0:1788639375.368746:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773103232 00000100:00100000:3.0:1788639375.368807:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788639375.368817:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+15:23534:x1875523773103232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639375.369966:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+15:23534:x1875523773103232:12345-0@lo:502:mount.lustre.0 Request processed in 1146us (3091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639375.369976:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788639375.370282:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773103232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639375.370509:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788639375.370523:0:23534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788639375.372246:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639375.372261:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.372263:0:23538:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788639375.372268:0:23538:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788639375.372271:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788639375.372285:0:23538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9ae36a0ecd40) 00000020:00000080:2.0:1788639375.372310:0:23538:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788639375.372316:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788639375.372410:0:23538:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788639375.372418:0:23538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262dc2a 00000020:00000080:2.0:1788639375.373164:0:23538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788639375.373172:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639375.373177:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.373178:0:23538:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788639375.373182:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639375.373186:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.373188:0:23538:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788639375.373192:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788639375.373201:0:23538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9ae36a0e8000) 00000020:00000080:2.0:1788639375.373216:0:23538:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788639375.373220:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788639375.373230:0:23538:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788639375.373232:0:23538:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788639375.373240:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788639375.373295:0:23538:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae342c41800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788639375.373307:0:23538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9ae36a0eb380) 00000020:00000080:2.0:1788639375.373317:0:23538:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788639375.373367:0:23538:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788639375.373373:0:23538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262dc3f 00000020:00000080:2.0:1788639375.373951:0:23538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788639375.373962:0:23538:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788639375.373969:0:23538:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x25c454990262dc46 00080000:01000000:2.0:1788639375.373976:0:23538:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788639375.373980:0:23538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262dc4d 00010000:00010000:2.0:1788639375.451195:0:23538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788639375.452119:0:23538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788639375.453509:0:23538:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788639375.456412:0:23538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788639375.456426:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639375.456432:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639375.456434:0:23538:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788639375.456437:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639375.456443:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639375.456444:0:23538:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788639375.456448:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788639375.456453:0:23538:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:00000080:0.0:1788639375.456480:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788639375.456493:0:23538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9ae36cf099c0) 00000020:00000080:0.0:1788639375.456515:0:23538:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788639375.456520:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788639375.456601:0:23538:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788639375.456608:0:23538:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788639375.456632:0:23538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262dc5b 00010000:00080000:0.0:1788639375.456663:0:23538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae2416ee800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788639375.460946:0:23538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788639375.462343:0:23538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788639375.462357:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788639375.462392:0:23538:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788639375.462413:0:23538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262dc62 00000100:00080000:0.0:1788639375.462424:0:23538:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788639375.462430:0:23538:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ae2416ee800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788639375.466100:0:23538:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae3748aad80 x1875523773103360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788639375.466141:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773103360:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788639375.466214:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639375.466272:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773103360 00000100:00100000:0.0:1788639375.466279:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773103360 00000100:00100000:0.0:1788639375.466308:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788639375.466315:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875523773103360:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788639375.466336:0:22807:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:0.0:1788639375.466369:0:22807:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262dc69 00000004:00100000:0.0:1788639375.466383:0:22807:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788639375.466388:0:22807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1788639375.466492:0:23538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788639375.466520:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788639375.466524:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788639375.466528:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae2433e9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788639375.466552:0:13809:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 632 00000100:00080000:0.0:1788639375.466557:0:13809:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788639375.466562:0:13809:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ae2433e9000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788639375.466592:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae3748a9c00 x1875523773103488/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788639375.466606:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788639375.466609:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788639375.466612:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788639375.466634:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788639375.466662:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639375.466671:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773103616:0@lo:400:kworker.0 00000100:00100000:0.0:1788639375.466699:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639375.466726:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773103616 00000100:00100000:0.0:1788639375.466729:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773103616 00000100:00100000:0.0:1788639375.466756:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788639375.466762:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773103616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639375.466798:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773103616:12345-0@lo:400:kworker.0 Request processed in 36us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639375.466804:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788639375.466837:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae3748ab800 x1875523773103616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639375.466848:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773103616:0@lo:400:kworker.0 00000100:00100000:0.0:1788639375.466866:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773103488:0@lo:38:kworker.0 00000100:00100000:0.0:1788639375.466885:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639375.466913:0:22808:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788639375.466919:0:22808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000020:01000000:0.0:1788639375.467216:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639375.467222:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639375.467224:0:23538:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788639375.467227:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788639375.467229:0:23538:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788639375.467231:0:23538:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788639375.467232:0:23538:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788639375.467234:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788639375.467236:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639375.467237:0:23538:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788639375.467239:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639375.467243:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639375.467245:0:23538:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788639375.467248:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788639375.467291:0:23538:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788639375.467302:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639375.467304:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639375.467306:0:23538:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788639375.467308:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788639375.467310:0:23538:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788639375.467311:0:23538:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788639375.467313:0:23538:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788639375.467314:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788639375.467316:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639375.467317:0:23538:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788639375.467319:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788639375.467322:0:23538:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788639375.467324:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639375.467326:0:23538:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788639375.467328:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788639375.467331:0:23538:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:0.0:1788639375.467347:0:23538:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788639375.467355:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788639375.467367:0:23538:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ae36cf0cd40) 00000020:00000080:0.0:1788639375.467381:0:23538:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788639375.467385:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788639375.467435:0:23538:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788639375.467441:0:23538:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788639375.467447:0:23538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262dc77 00010000:00080000:0.0:1788639375.467471:0:23538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae36d188000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788639375.467877:0:23538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788639375.468277:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773103488 00000100:00100000:0.0:1788639375.468282:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773103488 00000100:00100000:0.0:1788639375.468369:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788639375.468375:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875523773103488:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788639375.468435:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875523773103488:12345-0@lo:38:kworker.0 Request processed in 59us (1549us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788639375.468441:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788639375.468470:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788639375.468476:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2433e9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639375.468480:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788639375.468483:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773103488:0@lo:38:kworker.0 00000040:01000000:0.0:1788639375.470965:0:23538:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788639375.471327:0:23538:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788639375.472833:0:23538:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788639375.474383:0:23538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788639375.476683:0:23538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:2.0:1788639375.476872:0:22807:0:(import.c:65:import_set_state_nolock()) ffff9ae36d08a000 : changing import state from RECOVER to FULL 00000040:00080000:0.0:1788639375.476965:0:23544:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000100:00100000:2.0:1788639375.476966:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875523773103360:12345-0@lo:38:llog_process_th.0 Request processed in 10648us (10749us total) trans 0 rc 0/0 00000040:00080000:0.0:1788639375.476969:0:23544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788639375.476976:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788639375.477037:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788639375.477046:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788639375.477053:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788639375.477058:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788639375.477061:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2416ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788639375.477073:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773103360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788639375.477313:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773103744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639375.477351:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.477445:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773103744 00000100:00100000:1.0:1788639375.477452:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773103744 00000100:00100000:1.0:1788639375.477499:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788639375.477508:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875523773103744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639375.477533:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000020:00000080:2.0:1788639375.483008:0:23538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788639375.483021:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788639375.483069:0:23538:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788639375.483103:0:23538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262dc7e 00000100:00080000:2.0:1788639375.483114:0:23538:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788639375.483121:0:23538:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ae36d188000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639375.483154:0:23538:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2432cb800 x1875523773103872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639375.483190:0:23538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788639375.483268:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639375.483279:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.483281:0:23538:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788639375.483285:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788639375.483288:0:23538:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788639375.483289:0:23538:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639375.483291:0:23538:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639375.483292:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788639375.483295:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.483296:0:23538:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788639375.483299:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788639375.483302:0:23538:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788639375.483305:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.483307:0:23538:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788639375.483310:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788639375.483313:0:23538:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:2.0:1788639375.483334:0:23538:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788639375.483337:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788639375.483347:0:23538:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ae36a0e99c0) 00000020:00000080:2.0:1788639375.483359:0:23538:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788639375.483364:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788639375.483424:0:23538:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788639375.483431:0:23538:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788639375.483435:0:23538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262dc8c 00010000:00080000:2.0:1788639375.483463:0:23538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae375f8d800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.118@tcp at head 00000100:00100000:0.0:1788639375.483776:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773103872:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788639375.483831:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773103872 offset 0 length 520: 4 00010000:00010000:2.0:1788639375.484426:0:23538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000100:00100000:1.0:1788639375.484570:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875523773103744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7061us (7215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639375.484582:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788639375.484652:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773103744:0@lo:41:osp-pre-0-1.0 00000040:01000000:2.0:1788639375.484690:0:23538:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788639375.484708:0:23538:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788639375.484716:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639375.484721:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639375.484724:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639375.484727:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788639375.490492:0:23538:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788639375.490755:0:23538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788639375.490912:0:23538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788639375.491680:0:23546:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788639375.491686:0:23546:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788639375.492317:0:23538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788639375.492333:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788639375.492375:0:23538:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788639375.492398:0:23538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262dc93 00000100:00080000:2.0:1788639375.492410:0:23538:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788639375.492417:0:23538:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ae375f8d800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639375.492454:0:23538:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2432c8000 x1875523773104000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639375.492481:0:23538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788639375.492536:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639375.492553:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.492555:0:23538:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788639375.492558:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639375.492562:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.492563:0:23538:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788639375.492566:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788639375.492568:0:23538:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788639375.492570:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639375.492572:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.492573:0:23538:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788639375.492576:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639375.492676:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.492678:0:23538:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788639375.492682:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788639375.492708:0:23538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639375.492711:0:23538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.492712:0:23538:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788639375.492715:0:23538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:0.0:1788639375.494217:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773104000:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788639375.494277:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773104000 offset 0 length 520: 4 00000100:00080000:3.0:1788639375.494739:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639375.494745:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639375.494747:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639375.494763:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788639375.494783:0:23534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788639375.494821:0:23534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788639375.494844:0:23534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262dc15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dc1c expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.494855:0:23534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262dc15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dc1c expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639375.494864:0:23534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae342c41800 from 1 10000000:01000000:3.0:1788639375.494867:0:23534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788639375.494899:0:23534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.494907:0:23534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.494918:0:23534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639375.494936:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788639375.494978:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639375.495007:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343da29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639375.495070:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773104128 00000100:00100000:0.0:1788639375.495086:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773104128 00000100:00100000:0.0:1788639375.495134:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788639375.495143:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+15:23534:x1875523773104128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639375.495154:0:22795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639375.495165:0:22795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3748dc600/0x25c454990262dca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dc9a expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.495196:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3748dc600/0x25c454990262dca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dc9a expref: 16 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.495206:0:22795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3748dc600/0x25c454990262dca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dc9a expref: 16 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.495214:0:22795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dc600, rc 0) 00000100:00100000:0.0:1788639375.495263:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+16:23534:x1875523773104128:12345-0@lo:101:mount.lustre.0 Request processed in 122us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639375.495269:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788639375.495351:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639375.495364:0:23534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.495372:0:23534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639375.495952:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104256:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788639375.496005:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.496039:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639375.496109:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773104256 00000100:00100000:2.0:1788639375.496115:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773104256 00000100:00100000:2.0:1788639375.496142:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788639375.496149:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+16:23534:x1875523773104256:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788639375.496183:0:22796:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788639375.496198:0:22796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788639375.496201:0:22796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788639375.496299:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+16:23534:x1875523773104256:12345-0@lo:256:mount.lustre.0 Request processed in 149us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639375.496306:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788639375.496373:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104256:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788639375.497012:0:23534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788639375.497029:0:23534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.497040:0:23534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639375.497813:0:23534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae342c41800 from 1 10000000:01000000:0.0:1788639375.497820:0:23534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788639375.497859:0:23534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.497868:0:23534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.497877:0:23534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639375.497908:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788639375.497959:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639375.498000:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344326d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639375.498117:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773104384 00000100:00100000:2.0:1788639375.498124:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773104384 00000100:00100000:2.0:1788639375.498181:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788639375.498191:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+16:23534:x1875523773104384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639375.498202:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639375.498216:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23000/0x25c454990262dcaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dca8 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639375.498238:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23000/0x25c454990262dcaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dca8 expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639375.498249:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23000/0x25c454990262dcaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dca8 expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639375.498257:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23000, rc 0) 00000100:00100000:2.0:1788639375.498292:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+17:23534:x1875523773104384:12345-0@lo:101:mount.lustre.0 Request processed in 102us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639375.498298:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788639375.498310:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639375.498324:0:23534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.498333:0:23534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788639375.500831:0:23534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1788639375.501126:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788639375.501328:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788639375.501351:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1788639375.501369:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1788639375.501384:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1788639375.501398:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1788639375.501413:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1788639375.501425:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1788639375.501439:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1788639375.501452:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788639375.501467:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1788639375.501481:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1788639375.501499:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1788639375.501505:0:23534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1788639375.501803:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639375.501861:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639375.501949:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3443269c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639375.503645:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773104512 00000100:00100000:3.0:1788639375.503658:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773104512 00000100:00100000:2.0:1788639375.503749:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788639375.503762:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+17:23534:x1875523773104512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639375.503930:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+17:23534:x1875523773104512:12345-0@lo:501:mount.lustre.0 Request processed in 171us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639375.503950:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788639375.503986:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639375.504031:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104640:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639375.504087:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639375.504122:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3443269c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639375.504277:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773104640 00000100:00100000:2.0:1788639375.504282:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773104640 00000100:00100000:2.0:1788639375.504316:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788639375.504324:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+17:23534:x1875523773104640:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639375.504415:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+17:23534:x1875523773104640:12345-0@lo:503:mount.lustre.0 Request processed in 91us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639375.504421:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788639375.504500:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104640:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788639375.505349:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788639375.505420:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639375.505473:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639375.505550:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343da2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788639375.505985:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773104768 00000100:00100000:2.0:1788639375.505992:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773104768 00000100:00100000:2.0:1788639375.506072:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788639375.506093:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+17:23534:x1875523773104768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639375.506359:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+17:23534:x1875523773104768:12345-0@lo:502:mount.lustre.0 Request processed in 267us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639375.506367:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788639375.506464:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788639375.507047:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788639375.507099:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1788639375.507117:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1788639375.507130:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1788639375.507142:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1788639375.507155:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1788639375.507168:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1788639375.507246:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1788639375.507271:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788639375.507286:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1788639375.507300:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1788639375.507336:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639375.507389:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639375.507468:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788639375.507518:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773104896 00000100:00100000:3.0:1788639375.507526:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773104896 00000100:00100000:3.0:1788639375.507858:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788639375.507869:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+17:23534:x1875523773104896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639375.508044:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+17:23534:x1875523773104896:12345-0@lo:502:mount.lustre.0 Request processed in 177us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639375.508051:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788639375.508143:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773104896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788639375.508269:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1788639375.508281:0:23534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788639375.509295:0:23548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639375.509306:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.509309:0:23548:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788639375.509316:0:23548:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae342c41800 00000020:00000080:2.0:1788639375.509319:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788639375.509326:0:23548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639375.509329:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.509330:0:23548:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788639375.509332:0:23548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639375.509335:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.509336:0:23548:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788639375.509339:0:23548:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae342c41800 00000020:00000080:2.0:1788639375.509341:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788639375.509448:0:23548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639375.509453:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.509455:0:23548:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788639375.509457:0:23548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639375.509460:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.509461:0:23548:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788639375.509465:0:23548:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae342c41800 00000020:00000080:2.0:1788639375.509468:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788639375.512525:0:23548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639375.512540:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.512542:0:23548:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788639375.512547:0:23548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639375.512552:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.512553:0:23548:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788639375.512559:0:23548:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae342c41800 00000020:00000080:2.0:1788639375.512561:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788639375.512650:0:23548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639375.512654:0:23548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639375.512655:0:23548:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788639375.512659:0:23548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1788639375.512837:0:23534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788639375.512868:0:23534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788639375.512891:0:23534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.512904:0:23534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639375.512959:0:23534:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788639375.512963:0:23534:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae342c41800 10000000:01000000:3.0:1788639375.512966:0:23534:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae342c41800 10000000:01000000:3.0:1788639375.512970:0:23534:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788639375.512975:0:23534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae342c41800 from 1 10000000:01000000:3.0:1788639375.512978:0:23534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788639375.513011:0:23534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f200/0x25c454990262dcb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.513019:0:23534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f200/0x25c454990262dcb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.513046:0:23534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f200/0x25c454990262dcb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639375.513070:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105024:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788639375.513144:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639375.513192:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343da2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788639375.513328:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773105024 00000100:00100000:1.0:1788639375.513342:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773105024 00000100:00100000:1.0:1788639375.513393:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788639375.513402:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+17:23534:x1875523773105024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639375.513414:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639375.513426:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f9a00/0x25c454990262dcbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dcb6 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.513450:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f9a00/0x25c454990262dcbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dcb6 expref: 18 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.513460:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f9a00/0x25c454990262dcbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dcb6 expref: 18 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.513469:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9a00, rc 0) 00000100:00100000:1.0:1788639375.513510:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105024:12345-0@lo:101:mount.lustre.0 Request processed in 110us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639375.513517:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788639375.513574:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639375.513588:0:23534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f200/0x25c454990262dcb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dcbd expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.513596:0:23534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f200/0x25c454990262dcb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dcbd expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639375.518000:0:23534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1788639375.518354:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788639375.524808:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788639375.524871:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788639375.524894:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788639375.524912:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788639375.525155:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788639375.525174:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788639375.525182:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788639375.525190:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788639375.525199:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788639375.525209:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788639375.525220:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788639375.525227:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788639375.525234:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788639375.525249:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788639375.525257:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788639375.525264:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788639375.525272:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788639375.525279:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788639375.525297:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788639375.525307:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788639375.525314:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788639375.525321:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788639375.525336:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788639375.525351:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788639375.525366:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788639375.525381:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788639375.525396:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788639375.525411:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788639375.525427:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788639375.525442:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788639375.525712:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788639375.525726:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788639375.525739:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788639375.525752:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788639375.525782:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788639375.525799:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788639375.525816:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788639375.525833:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788639375.525846:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788639375.525961:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788639375.525983:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788639375.526005:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788639375.526026:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788639375.526047:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788639375.526067:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788639375.526102:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788639375.526134:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788639375.526151:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788639375.526311:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788639375.526365:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788639375.526395:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788639375.526401:0:23534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788639375.526525:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639375.526575:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639375.526730:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639375.526896:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773105152 00000100:00100000:3.0:1788639375.526903:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773105152 00000100:00100000:3.0:1788639375.526958:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788639375.526968:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639375.527112:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105152:12345-0@lo:501:mount.lustre.0 Request processed in 145us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639375.527119:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788639375.527322:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639375.527360:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105280:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639375.527399:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.527436:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639375.527483:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773105280 00000100:00100000:3.0:1788639375.527488:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773105280 00000100:00100000:3.0:1788639375.527520:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788639375.527527:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639375.527692:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105280:12345-0@lo:503:mount.lustre.0 Request processed in 164us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639375.527699:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788639375.528321:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105280:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788639375.528734:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788639375.528804:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639375.528854:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.528890:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773105408 00000100:00100000:1.0:1788639375.528895:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773105408 00000100:00100000:1.0:1788639375.528927:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788639375.528935:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639375.529022:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105408:12345-0@lo:502:mount.lustre.0 Request processed in 87us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639375.529029:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788639375.529065:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639375.529092:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639375.533375:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1788639375.533426:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1788639375.533440:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1788639375.533453:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1788639375.533467:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1788639375.533480:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1788639375.533512:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1788639375.533528:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1788639375.533550:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1788639375.533566:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1788639375.533580:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1788639375.533593:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1788639375.533606:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1788639375.533638:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1788639375.533663:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1788639375.533678:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1788639375.533691:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1788639375.533705:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1788639375.533718:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1788639375.533731:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1788639375.533744:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1788639375.533757:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1788639375.533783:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1788639375.533800:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1788639375.533814:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1788639375.533827:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1788639375.533841:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1788639375.533854:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1788639375.533866:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1788639375.533878:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1788639375.533892:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1788639375.533905:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1788639375.533917:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1788639375.533928:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1788639375.533940:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1788639375.533952:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1788639375.533964:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1788639375.533975:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1788639375.534000:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1788639375.534014:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1788639375.534026:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1788639375.534039:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1788639375.534052:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1788639375.534066:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1788639375.534091:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1788639375.534105:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1788639375.534117:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1788639375.534141:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1788639375.534205:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639375.534278:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.534332:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773105536 00000100:00100000:1.0:1788639375.534339:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773105536 00000100:00100000:1.0:1788639375.534377:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788639375.534385:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639375.534487:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105536:12345-0@lo:502:mount.lustre.0 Request processed in 101us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639375.534494:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788639375.534548:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639375.534567:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639375.534754:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1788639375.534776:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1788639375.534796:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639375.534827:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.534857:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773105664 00000100:00100000:1.0:1788639375.534862:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773105664 00000100:00100000:1.0:1788639375.534884:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788639375.534890:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639375.534946:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105664:12345-0@lo:502:mount.lustre.0 Request processed in 56us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639375.534952:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788639375.534980:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639375.534993:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639375.535030:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1788639375.535042:0:23534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788639375.540910:0:23553:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788639375.540928:0:23553:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9ae3691c99c0) 00000020:00000080:3.0:1788639375.540950:0:23553:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788639375.541035:0:23553:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae342c41800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788639375.541043:0:23553:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae342c41800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788639375.541046:0:23553:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae342c41800 3 00010000:00080000:3.0:1788639375.541093:0:23553:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae362571000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788639375.549291:0:23553:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788639375.549488:0:23553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788639375.549530:0:23553:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788639375.549542:0:23553:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x25c454990262dccb 00000100:00080000:3.0:1788639375.549551:0:23553:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788639375.549556:0:23553:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ae362571000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639375.550084:0:23553:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc0a80 x1875523773105792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639375.550112:0:23553:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788639375.550136:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639375.550141:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639375.550144:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639375.550146:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788639375.550784:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875523773105792:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788639375.550851:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.550953:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773105792 00000100:00100000:1.0:1788639375.550961:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773105792 00000100:00100000:1.0:1788639375.550994:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788639375.551001:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523773105792:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788639375.551023:0:22802:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:1.0:1788639375.551063:0:22802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x25c454990262dcd2 00000004:00100000:1.0:1788639375.555786:0:22802:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788639375.555992:0:22802:0:(import.c:65:import_set_state_nolock()) ffff9ae243aec800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639375.556101:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875523773105792:12345-0@lo:38:llog_process_th.0 Request processed in 5096us (5246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639375.556111:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788639375.557807:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae342fc0a80 x1875523773105792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639375.557823:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639375.557834:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788639375.557845:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788639375.557850:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788639375.557853:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae362571000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788639375.557860:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875523773105792:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788639375.561099:0:23553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1788639375.562823:0:23534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788639375.562863:0:23534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788639375.562883:0:23534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f200/0x25c454990262dcb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dcbd expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639375.562907:0:23534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f200/0x25c454990262dcb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dcbd expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788639375.562968:0:23534:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788639375.562971:0:23534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788639375.562972:0:23534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639375.562974:0:23534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639375.562975:0:23534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639375.562976:0:23534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639375.562978:0:23534:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788639375.562980:0:23534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639375.562981:0:23534:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788639375.562985:0:23534:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788639375.562987:0:23534:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788639375.562988:0:23534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788639375.562989:0:23534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639375.562990:0:23534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639375.562991:0:23534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639375.562992:0:23534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639375.562993:0:23534:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788639375.562994:0:23534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639375.562995:0:23534:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788639375.563020:0:23534:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788639375.563040:0:23534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105920:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788639375.563113:0:23534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.563151:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773105920 00000100:00100000:1.0:1788639375.563158:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773105920 00000100:00100000:1.0:1788639375.563510:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788639375.563520:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+18:23534:x1875523773105920:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788639375.563696:0:22795:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788639375.563709:0:22795:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788639375.563836:0:23534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35acc0 going to sleep for 11 seconds 00000001:00100000:3.0:1788639375.565022:0:22782:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788639375.565118:0:22795:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788639375.565146:0:22795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788639375.565265:0:22818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788639375.565269:0:22818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788639375.565288:0:22818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.565305:0:22818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2421f8400/0x25c454990262dbdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dbd6 expref: 18 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.565313:0:22818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3748dc600/0x25c454990262dca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dc9a expref: 18 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.565328:0:22818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.565361:0:22818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3748dc600/0x25c454990262dca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262dc9a expref: 18 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.565375:0:22818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae3748dc600/0x25c454990262dca1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262dc9a expref: 18 pid: 22795 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639375.565389:0:22818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773106048:0@lo:104: 00000100:00100000:3.0:1788639375.565443:0:22818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788639375.565488:0:22818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2421f8400/0x25c454990262dbdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262dbd6 expref: 18 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639375.565496:0:22818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2421f8400/0x25c454990262dbdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262dbd6 expref: 18 pid: 22795 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639375.565506:0:22818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773106176:0@lo:104: 00000100:00100000:3.0:1788639375.565526:0:22818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639375.568389:0:22818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae350c4f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788639375.569846:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773106048 00000100:00100000:0.0:1788639375.569858:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773106048 00000100:00100000:0.0:1788639375.569908:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773106176 00000100:00100000:0.0:1788639375.569911:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773106176 00000100:00100000:0.0:1788639375.569926:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788639375.569935:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+4:22818:x1875523773106048:12345-0@lo:104: 00010000:00010000:0.0:1788639375.569951:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.570050:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788639375.570056:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+4:22818:x1875523773106048:12345-0@lo:104: Request processed in 122us (4613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639375.570063:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788639375.570091:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788639375.570098:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+3:22818:x1875523773106176:12345-0@lo:104: 00010000:00010000:0.0:1788639375.570105:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.570138:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788639375.570143:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+3:22818:x1875523773106176:12345-0@lo:104: Request processed in 47us (4617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639375.570149:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788639375.570477:0:22818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773106048:0@lo:104: 00000100:00100000:0.0:1788639375.570488:0:22818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773106176:0@lo:104: 00010000:00010000:0.0:1788639375.570511:0:22818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.570529:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639375.570535:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.570864:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ee00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639375.570868:0:22790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.570876:0:22790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639375.570888:0:22790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639375.570893:0:22790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639375.570927:0:22790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.570933:0:22790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639375.570952:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.570959:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ee00/0x25c454990262dc9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dca1 expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.570971:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639375.570974:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.572133:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639375.572138:0:22790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.572148:0:22790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639375.572154:0:22790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639375.572236:0:22790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639375.572269:0:22790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.572276:0:22790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639375.572297:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.572303:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262dbd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dbdd expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.572318:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639375.572319:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639375.572321:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639375.572335:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639375.572352:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773106304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639375.572518:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639375.572698:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773106432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639375.572723:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639375.572778:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773106304 00000100:00100000:0.0:1788639375.572784:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773106304 00010000:00010000:0.0:1788639375.572810:0:22787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3748dc600/0x25c454990262dca1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dc9a expref: 19 pid: 22795 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639375.572833:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773106432 00000100:00100000:0.0:1788639375.572836:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773106432 00010000:00010000:0.0:1788639375.572846:0:22787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2421f8400/0x25c454990262dbdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dbd6 expref: 20 pid: 22795 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639375.572859:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788639375.572866:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+20:3643:x1875523773106304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639375.572895:0:22787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639375.572902:0:22787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3748dc600/0x25c454990262dca1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dc9a expref: 20 pid: 22795 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.572913:0:22787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3748dc600/0x25c454990262dca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262dc9a expref: 20 pid: 22795 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.572926:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3748dc600/0x25c454990262dca1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262dc9a expref: 20 pid: 22795 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.572939:0:22787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639375.572970:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+19:3643:x1875523773106304:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639375.572976:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788639375.574153:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788639375.574247:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+18:3641:x1875523773106432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639375.574262:0:22787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639375.574268:0:22787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2421f8400/0x25c454990262dbdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dbd6 expref: 18 pid: 22795 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.574281:0:22787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2421f8400/0x25c454990262dbdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262dbd6 expref: 18 pid: 22795 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.574295:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2421f8400/0x25c454990262dbdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262dbd6 expref: 18 pid: 22795 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.574310:0:22787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.574318:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788639375.574341:0:22787:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009072010s 00010000:00010000:0.0:1788639375.574346:0:22787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.574353:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.574360:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.574366:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639375.574634:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639375.575066:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639375.575071:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.575101:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.575118:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.575130:0:22787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639375.575276:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+17:3641:x1875523773106432:12345-0@lo:103:ldlm_bl.0 Request processed in 1034us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639375.575284:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788639375.575318:0:22818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.575341:0:22818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639375.575348:0:22818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f9e000/0x25c454990262dcd9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639375.575996:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773106432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639375.576041:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773106304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639375.582259:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+16:23534:x1875523773105920:12345-0@lo:253:mount.lustre.0 Request processed in 18733us (19138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639375.582272:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788639375.582291:0:23534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:23534:1875523773105920:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788639375.582305:0:23534:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788639375.582308:0:23534:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788639375.582310:0:23534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788639375.582311:0:23534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639375.582312:0:23534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639375.582313:0:23534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639375.582314:0:23534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639375.582316:0:23534:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788639375.582318:0:23534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639375.582319:0:23534:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788639375.582332:0:23534:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1788639375.589012:0:23534:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788639375.589267:0:23560:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788639375.589270:0:23560:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788639375.596272:0:23561:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788639375.596761:0:23534:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788639375.597136:0:23562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875523773106560:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788639375.597359:0:23534:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788639375.597394:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788639375.597868:0:23534:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788639375.597876:0:23534:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788639375.597909:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788639375.599070:0:23534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788639375.599938:0:23562:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639375.599992:0:23562:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3600 going to sleep for 11 seconds 00000040:00080000:3.0:1788639375.600373:0:23561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788639375.601001:0:23534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788639375.601053:0:23534:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788639375.601167:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788639375.602770:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773106560 00000100:00100000:2.0:1788639375.602783:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773106560 00000100:00100000:2.0:1788639375.602875:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788639375.602886:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23562:x1875523773106560:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788639375.602991:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23562:x1875523773106560:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 107us (3055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639375.602999:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1788639375.604095:0:23561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788639375.604160:0:23561:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00080000:10000000:1.0:1788639375.604929:0:23534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:1.0:1788639375.605785:0:23562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875523773106560:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788639375.605822:0:23562:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788639375.605864:0:23562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875523773106688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788639375.605924:0:23562:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:1.0:1788639375.609347:0:23534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:1.0:1788639375.610119:0:22838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788639375.610314:0:23562:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d325a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788639375.610378:0:23543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773106688 00000100:00100000:0.0:1788639375.610387:0:23543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773106688 00000100:00100000:0.0:1788639375.610430:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788639375.610440:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23562:x1875523773106688:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788639375.610748:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23562:x1875523773106688:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 309us (4823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639375.610756:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788639375.610783:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00000100:00100000:1.0:1788639375.611315:0:23562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875523773106688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788639375.611415:0:23562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23562:1875523773106816:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788639375.611454:0:23562:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639375.611491:0:23562:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c81540 going to sleep for 11 seconds 00000100:00100000:0.0:1788639375.611568:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773106816 00000100:00100000:0.0:1788639375.611574:0:22813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773106816 00000100:00100000:0.0:1788639375.613442:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788639375.613462:0:22813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23562:x1875523773106816:12345-0@lo:900:lod0001_rec0000.0 00000001:00080000:1.0:1788639375.613773:0:23534:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788639375.613804:0:23534:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaea581c67988 00100000:10000000:1.0:1788639375.613812:0:23534:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:0.0:1788639375.613943:0:22813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23562:x1875523773106816:12345-0@lo:900:lod0001_rec0000.0 Request processed in 482us (2487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639375.613950:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788639375.613997:0:23562:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae375c49500 x1875523773106816/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788639391 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639375.614010:0:23562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23562:1875523773106816:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788639375.614087:0:23562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875523773106944:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788639375.614126:0:23562:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639375.614156:0:23562:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788639375.614298:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773106944 00000100:00100000:2.0:1788639375.614305:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773106944 00000100:00100000:2.0:1788639375.614334:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788639375.614342:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23562:x1875523773106944:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788639375.614411:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23562:x1875523773106944:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 70us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639375.614418:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788639375.614450:0:23562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23562:1875523773106944:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788639375.614503:0:23562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:1.0:1788639375.616266:0:23534:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788639375.616297:0:23534:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788639375.616315:0:23534:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788639375.616334:0:23534:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788639375.617103:0:23534:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788639375.617305:0:23534:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788639375.625295:0:23562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788639375.625373:0:23562:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788639375.625378:0:23562:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788639376.250254:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639376.638002:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00000040:00080000:1.0:1788639376.639272:0:23559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788639377.141730:0:22799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788639377.141742:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae342c41800 from 12 10000000:01000000:2.0:1788639377.141749:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788639377.141810:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639377.141825:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639377.141838:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639377.141874:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773107072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639377.141970:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639377.142031:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259000 going to sleep for 11 seconds 00000100:00100000:1.0:1788639377.142158:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773107072 00000100:00100000:1.0:1788639377.142169:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773107072 00000100:00100000:1.0:1788639377.142256:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788639377.142268:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+16:22799:x1875523773107072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639377.142284:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639377.142303:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f9e00/0x25c454990262dce7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dce0 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639377.142333:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f9e00/0x25c454990262dce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dce0 expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639377.142346:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f9e00/0x25c454990262dce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dce0 expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639377.142358:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9e00, rc 0) 00000100:00100000:1.0:1788639377.142417:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+17:22799:x1875523773107072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639377.142436:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788639377.142660:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773107072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639377.142680:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639377.142701:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639377.142767:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773107200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788639377.142808:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639377.142844:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639377.142913:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773107200 00000100:00100000:2.0:1788639377.142918:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773107200 00000100:00100000:2.0:1788639377.142961:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788639377.142970:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+17:22799:x1875523773107200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788639377.142988:0:22796:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788639377.143007:0:22796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788639377.143011:0:22796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788639377.143105:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+17:22799:x1875523773107200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639377.143121:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788639377.143200:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773107200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788639377.143266:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788639377.143275:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639377.143284:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639377.143295:0:22799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788639377.143298:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae36cf54000 from 12 10000000:01000000:3.0:1788639377.143301:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788639377.143323:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639377.143331:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639377.143340:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639377.143355:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773107328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639377.143392:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639377.143421:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35872f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639377.143534:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773107328 00000100:00100000:2.0:1788639377.143539:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773107328 00000100:00100000:2.0:1788639377.143572:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788639377.143580:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae344ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+17:22799:x1875523773107328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639377.143589:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639377.143602:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23800/0x25c454990262dcf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dcee expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639377.143652:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23800/0x25c454990262dcf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dcee expref: 18 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639377.143662:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23800/0x25c454990262dcf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dcee expref: 18 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639377.143670:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23800, rc 0) 00000100:00100000:2.0:1788639377.143700:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae344ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+18:22799:x1875523773107328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639377.143707:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788639377.144062:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773107328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639377.144088:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639377.144099:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639377.144150:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773107456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788639377.144188:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639377.144321:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35872f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639377.148437:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773107456 00000100:00100000:2.0:1788639377.148459:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773107456 00000100:00100000:2.0:1788639377.148593:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788639377.148606:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae344eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+18:22799:x1875523773107456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788639377.148659:0:22796:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788639377.148686:0:22796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788639377.148690:0:22796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788639377.148868:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae344eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+18:22799:x1875523773107456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 264us (4678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639377.148886:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788639377.149276:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773107456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788639377.149347:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788639377.149359:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639377.149371:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639377.271458:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639377.652724:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00000040:00080000:3.0:1788639377.654059:0:23559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788639378.295758:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639378.676805:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00010000:00010000:1.0:1788639379.317830:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639379.702326:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00010000:00010000:0.0:1788639380.341110:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788639380.654391:0:23804:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788639380.660788:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788639380.660794:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788639380.660798:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae2433e9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788639380.660809:0:13809:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ae2433e9000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639380.660830:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375c4a300 x1875523773107840/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788639380.660831:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773107584:0@lo:400:kworker.0 00000100:00080000:1.0:1788639380.660844:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639380.660848:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639380.660850:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639380.660852:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639380.660866:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639380.660868:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639380.660871:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639380.660874:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788639380.660904:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773107712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639380.660913:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639380.660972:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773108096:0@lo:400:kworker.0 00000100:00100000:1.0:1788639380.664701:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639380.664755:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788639380.664767:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773107968:0@lo:400:kworker.0 00000100:00100000:1.0:1788639380.664828:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639380.666554:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773107712 00000100:00100000:1.0:1788639380.666565:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773107712 00000100:00100000:0.0:1788639380.666715:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773108224:0@lo:400:kworker.0 00000100:00100000:1.0:1788639380.666789:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788639380.666802:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773107712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639380.666866:0:22807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788639380.666916:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773107712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639380.666923:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788639380.666968:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773107712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639380.667006:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773107584 00000100:00100000:1.0:1788639380.667010:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773107584 00000100:00100000:1.0:1788639380.667036:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788639380.667042:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+18:3642:x1875523773107584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639380.667086:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+18:3642:x1875523773107584:12345-0@lo:400:kworker.0 Request processed in 43us (6172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639380.667092:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788639380.667132:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773107968 00000100:00100000:1.0:1788639380.667136:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773107968 00000100:00100000:1.0:1788639380.667161:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788639380.667167:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773107968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639380.667203:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773107968:12345-0@lo:400:kworker.0 Request processed in 36us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639380.667209:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788639380.667239:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae375c49f80 x1875523773107968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639380.667266:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773107968:0@lo:400:kworker.0 00000100:00100000:0.0:1788639380.668326:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639380.668382:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773107584:0@lo:400:kworker.0 00000100:00100000:2.0:1788639380.668537:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773107840:0@lo:38:kworker.0 00000100:00100000:2.0:1788639380.668671:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639380.668864:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773107840 00000100:00100000:0.0:1788639380.668870:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773107840 00000100:00100000:1.0:1788639380.668902:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773108224 00000100:00100000:1.0:1788639380.668907:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773108224 00000100:00100000:1.0:1788639380.668938:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788639380.668945:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773108224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639380.668983:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788639380.668989:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875523773107840:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788639380.668992:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773108224:12345-0@lo:400:kworker.0 Request processed in 47us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639380.668997:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788639380.669039:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae375c48700 x1875523773108224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639380.669061:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773108224:0@lo:400:kworker.0 00010000:00080000:2.0:1788639380.669374:0:23543:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 639 last 0 00000020:00000080:2.0:1788639380.669406:0:23543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262dcfc 00000004:00100000:2.0:1788639380.669420:0:23543:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788639380.669426:0:23543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788639380.669768:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639380.689979:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773108096 00000100:00100000:2.0:1788639380.689994:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773108096 00000100:00100000:2.0:1788639380.693608:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788639380.693641:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773108096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639380.693745:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773108096:12345-0@lo:400:kworker.0 Request processed in 107us (23976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639380.693752:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788639380.694140:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773108096:0@lo:400:kworker.0 00000100:00080000:3.0:1788639380.706415:0:23543:0:(import.c:65:import_set_state_nolock()) ffff9ae3603a8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639380.706513:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875523773107840:12345-0@lo:38:kworker.0 Request processed in 37521us (37840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639380.706523:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788639380.706692:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788639380.706701:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788639380.706706:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788639380.706709:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2433e9000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788639380.706726:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000db15de37): req@ffff9ae2432c9180 x1875523773100800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639380.706752:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773107840:0@lo:38:kworker.0 00000100:00100000:1.0:1788639380.706805:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 0 seconds 00000100:00100000:1.0:1788639380.706854:0:22844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639380.706887:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639380.707033:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773100800 00000100:00100000:2.0:1788639380.707040:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773100800 00000100:00100000:2.0:1788639380.707095:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788639380.707104:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22844:x1875523773100800:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788639380.707186:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22844:x1875523773100800:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 82us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639380.707193:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788639380.707306:0:22844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22844:1875523773100800:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788639380.707340:0:22844:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788639380.707379:0:22844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22844:1875523773108352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788639380.707408:0:22844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639380.707439:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae380208e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788639380.707462:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773108352 00000100:00100000:1.0:1788639380.707466:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773108352 00000100:00100000:1.0:1788639380.707489:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788639380.707495:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22844:x1875523773108352:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788639380.707638:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22844:x1875523773108352:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 120us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639380.707653:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788639380.707681:0:22844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22844:1875523773108352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788639380.707739:0:22844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22844:1875523773108480:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788639380.707763:0:22844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639380.707828:0:22844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae380208e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788639380.707841:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773108480 00000100:00100000:1.0:1788639380.707844:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773108480 00000100:00100000:1.0:1788639380.707862:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788639380.707867:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22844:x1875523773108480:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788639380.707912:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22844:x1875523773108480:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 44us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639380.707918:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788639380.707938:0:22844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22844:1875523773108480:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788639380.707974:0:22844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788639380.708128:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773108608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639380.708158:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639380.709037:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773108608 00000100:00100000:2.0:1788639380.709044:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773108608 00000100:00100000:2.0:1788639380.709089:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788639380.709097:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773108608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639380.709124:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788639380.709191:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773108608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639380.709199:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788639380.710065:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773108608:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788639380.713540:0:22844:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788639380.717684:0:22844:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:1.0:1788639380.717693:0:22844:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788639381.367848:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788639381.517290:0:23857:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788639381.517493:0:23857:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788639382.403115:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788639382.518847:0:23907:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788639382.519933:0:23907:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788639383.418611:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788639383.563270:0:23955:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9f44d2d0 20000000:00000080:2.0:1788639383.563288:0:23955:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae35749f000 uarg=0000000000000000 20000000:01000000:2.0:1788639383.563327:0:23955:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788639383.563334:0:23955:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788639383.563338:0:23955:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788639383.563850:0:23956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788639383.564061:0:23955:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788639383.574678:0:23955:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788639383.574710:0:23955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639383.574729:0:23955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f9f600/0x25c454990262dbac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dba5 expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639383.574756:0:23955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f23000/0x25c454990262dcaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dca8 expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639383.574764:0:23955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639383.574805:0:23955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f23000/0x25c454990262dcaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262dca8 expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639383.574820:0:23955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae242f23000/0x25c454990262dcaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262dca8 expref: 17 pid: 22796 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639383.574834:0:23955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23955:1875523773108736:0@lo:104: 00000100:00100000:2.0:1788639383.574965:0:23955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639383.575024:0:23955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f9f600/0x25c454990262dbac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262dba5 expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639383.575042:0:23955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae242f9f600/0x25c454990262dbac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262dba5 expref: 17 pid: 22796 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639383.575051:0:23955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23955:1875523773108864:0@lo:104: 00000100:00100000:2.0:1788639383.575074:0:23955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639383.575092:0:23955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae347ebd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639383.575178:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773108736 00000100:00100000:0.0:1788639383.575185:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773108736 00000100:00100000:0.0:1788639383.575221:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773108864 00000100:00100000:0.0:1788639383.575224:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773108864 00000100:00100000:0.0:1788639383.575238:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788639383.575246:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a452a6f1-70bc-4918-a445-81111879f6e1+4:23955:x1875523773108736:12345-0@lo:104: 00010000:00010000:0.0:1788639383.575258:0:22785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.575324:0:22785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788639383.575330:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a452a6f1-70bc-4918-a445-81111879f6e1+4:23955:x1875523773108736:12345-0@lo:104: Request processed in 85us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639383.575338:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788639383.575354:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788639383.575360:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a452a6f1-70bc-4918-a445-81111879f6e1+3:23955:x1875523773108864:12345-0@lo:104: 00010000:00010000:0.0:1788639383.575367:0:22785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.575397:0:22785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788639383.575401:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a452a6f1-70bc-4918-a445-81111879f6e1+3:23955:x1875523773108864:12345-0@lo:104: Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639383.575407:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788639383.575471:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788639383.575479:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639383.575487:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dce00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639383.575490:0:22790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639383.575498:0:22790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639383.575505:0:22790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639383.575511:0:22790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788639383.575547:0:22790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639383.575553:0:22790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639383.575571:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639383.575578:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3748dce00/0x25c454990262dca8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dcaf expref: -99 pid: 23534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639383.575592:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639383.575595:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639383.575609:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dc400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639383.575638:0:22790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639383.575646:0:22790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639383.575652:0:22790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639383.575657:0:22790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788639383.575671:0:22790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639383.575677:0:22790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639383.575688:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639383.575695:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262dba5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dbac expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639383.575708:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639383.575710:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639383.575711:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639383.575723:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a452a6f1-70bc-4918-a445-81111879f6e1:3644:1875523773108992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639383.575752:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639383.575917:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773109120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639383.575941:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639383.575977:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773108992 00000100:00100000:0.0:1788639383.575980:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773108992 00010000:00010000:0.0:1788639383.575998:0:22787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f23000/0x25c454990262dcaf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dca8 expref: 18 pid: 22796 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639383.576024:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773109120 00000100:00100000:0.0:1788639383.576027:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773109120 00010000:00010000:0.0:1788639383.576053:0:22787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f9f600/0x25c454990262dbac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dba5 expref: 19 pid: 22796 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639383.576066:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788639383.576071:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+19:3644:x1875523773108992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639383.576080:0:22787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639383.576085:0:22787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f23000/0x25c454990262dcaf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dca8 expref: 19 pid: 22796 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576094:0:22787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f23000/0x25c454990262dcaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262dca8 expref: 19 pid: 22796 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576108:0:22787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639383.576137:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+19:3644:x1875523773108992:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639383.576144:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788639383.576156:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788639383.576161:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+18:3641:x1875523773109120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639383.576169:0:22787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639383.576173:0:22787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f9f600/0x25c454990262dbac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dba5 expref: 18 pid: 22796 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576182:0:22787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f9f600/0x25c454990262dbac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262dba5 expref: 18 pid: 22796 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576194:0:22787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576207:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576220:0:22787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576228:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576234:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576241:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576246:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639383.576250:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576258:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576267:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639383.576276:0:22787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639383.576303:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+18:3641:x1875523773109120:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639383.576309:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788639383.576343:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773109120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639383.576375:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a452a6f1-70bc-4918-a445-81111879f6e1:3644:1875523773108992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639383.576610:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639383.576735:0:23955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f23000/0x25c454990262dcaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262dca8 expref: 17 pid: 22796 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639383.576746:0:23955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23955:1875523773108736:0@lo:104: 00010000:00010000:2.0:1788639383.576757:0:23955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f9f600/0x25c454990262dbac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262dba5 expref: 16 pid: 22796 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639383.576775:0:23955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23955:1875523773108864:0@lo:104: 00010000:00010000:2.0:1788639383.576791:0:23955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639383.576799:0:23955:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639383.576804:0:23955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639383.576810:0:23955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f22200/0x25c454990262dd03 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639384.439790:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788639385.401163:0:22799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788639385.401171:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae342c41800 from 13 10000000:01000000:0.0:1788639385.401176:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788639385.401222:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639385.401234:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639385.401245:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639385.401269:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639385.401330:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639385.401367:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243338cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639385.401770:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773109248 00000100:00100000:2.0:1788639385.401778:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773109248 00000100:00100000:2.0:1788639385.401834:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788639385.401844:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+16:22799:x1875523773109248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639385.401856:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639385.401870:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f22000/0x25c454990262dd11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dd0a expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639385.401894:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f22000/0x25c454990262dd11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dd0a expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639385.401905:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f22000/0x25c454990262dd11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dd0a expref: 17 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639385.401925:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22000, rc 0) 00000100:00100000:2.0:1788639385.401995:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+17:22799:x1875523773109248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639385.402002:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788639385.402060:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639385.402076:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639385.402085:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639385.402146:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639385.402172:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639385.402194:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e182600 going to sleep for 11 seconds 00000100:00100000:2.0:1788639385.402206:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773109376 00000100:00100000:2.0:1788639385.402210:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773109376 00000100:00100000:2.0:1788639385.402233:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788639385.402239:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+17:22799:x1875523773109376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639385.402336:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+17:22799:x1875523773109376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639385.402343:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788639385.402375:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639385.402401:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639385.402439:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639385.402452:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e182600 going to sleep for 11 seconds 00000100:00100000:2.0:1788639385.402463:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773109504 00000100:00100000:2.0:1788639385.402466:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773109504 00000100:00100000:2.0:1788639385.402493:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788639385.402499:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+17:22799:x1875523773109504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639385.402570:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+17:22799:x1875523773109504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639385.402578:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788639385.402648:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788639385.403289:0:24028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788639385.403347:0:22799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788639385.403363:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639385.403371:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639385.403380:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639385.403389:0:22799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788639385.403391:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae36cf54000 from 13 10000000:01000000:2.0:1788639385.403394:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788639385.403416:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639385.403423:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639385.403431:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639385.403445:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639385.403479:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639385.403505:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e182d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639385.403520:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773109632 00000100:00100000:2.0:1788639385.403524:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773109632 00000100:00100000:2.0:1788639385.403551:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788639385.403558:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+17:22799:x1875523773109632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639385.403566:0:22795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639385.403576:0:22795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23a00/0x25c454990262dd1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dd18 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639385.403595:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23a00/0x25c454990262dd1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dd18 expref: 18 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639385.403604:0:22795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23a00/0x25c454990262dd1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dd18 expref: 18 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639385.403612:0:22795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23a00, rc 0) 00000100:00100000:2.0:1788639385.403664:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+18:22799:x1875523773109632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639385.403670:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788639385.403706:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639385.403718:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639385.403725:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639385.403765:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639385.403788:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639385.403808:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e182d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639385.403818:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773109760 00000100:00100000:2.0:1788639385.403822:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773109760 00000100:00100000:2.0:1788639385.403839:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788639385.403845:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+18:22799:x1875523773109760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639385.403920:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+18:22799:x1875523773109760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639385.403927:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788639385.403956:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639385.403980:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639385.404016:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639385.404041:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e182d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639385.404053:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773109888 00000100:00100000:2.0:1788639385.404057:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773109888 00000100:00100000:2.0:1788639385.404077:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788639385.404082:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+18:22799:x1875523773109888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639385.404147:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+18:22799:x1875523773109888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639385.404155:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788639385.404193:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773109888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788639385.410415:0:24029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788639385.410680:0:22799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788639385.410703:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788639385.410729:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639385.410741:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639385.463064:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639385.780851:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639375/real 1788639375] req@ffff9ae2432c8000 x1875523773104000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639385 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639385.780882:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae2432c8000 x1875523773104000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639385 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639385.780910:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639375/real 1788639375] req@ffff9ae2432cb800 x1875523773103872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639385 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639385.780921:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae2432cb800 x1875523773103872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639385 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788639385.780939:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375f8d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639385.780947:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788639385.780950:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773104000:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788639385.780956:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d188000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639385.780959:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788639385.780962:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773103872:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788639385.781143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639385.781148:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788639385.781151:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639385.781154:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788639385.781195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639385.781198:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788639385.781201:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae36d188000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639385.781205:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 634 00000100:00080000:2.0:1788639385.781211:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788639385.781216:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ae36d188000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639385.781234:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2432c9500 x1875523773110400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639385.781246:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639385.781249:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788639385.781250:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae375f8d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639385.781253:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 634 00000100:00080000:2.0:1788639385.781255:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788639385.781258:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ae375f8d800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639385.781268:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2432cb480 x1875523773110528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639385.781298:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773110016:0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.781404:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639385.781451:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788639385.781457:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773110656:0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.781501:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639385.781541:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773110272:0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.781565:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639385.781582:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639385.781587:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773110144:0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.781798:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639385.781971:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773110016 00000100:00100000:2.0:1788639385.781980:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773110016 00000100:00100000:2.0:1788639385.782018:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773110272 00000100:00100000:2.0:1788639385.782040:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773110272 00000100:00100000:2.0:1788639385.782058:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788639385.782065:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875523773110016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.782114:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875523773110016:12345-0@lo:400:kworker.0 Request processed in 49us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639385.782121:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788639385.782136:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788639385.782142:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773110272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.782174:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773110272:12345-0@lo:400:kworker.0 Request processed in 32us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639385.782180:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788639385.782201:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773110656 00000100:00100000:2.0:1788639385.782205:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773110656 00000100:00100000:2.0:1788639385.782228:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773110144 00000100:00100000:2.0:1788639385.782231:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773110144 00000100:00100000:2.0:1788639385.782244:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788639385.782249:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773110656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.782291:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773110656:12345-0@lo:400:kworker.0 Request processed in 42us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639385.782297:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788639385.782308:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788639385.782313:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773110144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.782339:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773110144:12345-0@lo:400:kworker.0 Request processed in 26us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639385.782352:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788639385.782396:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2432cb100 x1875523773110144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639385.782407:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773110144:0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.782415:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773110272:0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.782435:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773110400:0@lo:8:kworker.0 00000400:00000100:2.0:1788639385.782458:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773110400 offset 0 length 520: 4 00000100:00100000:2.0:1788639385.782478:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773110528:0@lo:8:kworker.0 00000400:00000100:2.0:1788639385.782493:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773110528 offset 0 length 520: 4 00010000:00080000:2.0:1788639385.782515:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2432c8700 x1875523773110656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639385.782524:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773110656:0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.782532:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773110016:0@lo:400:kworker.0 00000100:00100000:2.0:1788639385.786205:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639385.786231:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773110784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639385.786300:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639385.788812:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773110784 00000100:00100000:1.0:1788639385.788826:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773110784 00000100:00100000:1.0:1788639385.788895:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788639385.788904:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773110784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639385.788939:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788639385.789010:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773110784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (2708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639385.789016:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788639385.789690:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773110784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639385.793820:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773110912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639385.793889:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639385.794003:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773110912 00000100:00100000:0.0:1788639385.794010:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773110912 00000100:00100000:0.0:1788639385.794062:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788639385.794071:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773110912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788639385.794100:0:22807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788639385.794148:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773110912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639385.794155:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788639385.794194:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773110912:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788639385.845367:0:22838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1788639386.299086:0:23535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788639386.487314:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639387.511967:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788639387.893319:0:23559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788639388.532825:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639388.853710:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639373/real 1788639373] req@ffff9ae342fc1c00 x1875523773101952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639388 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639388.853748:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae342fc1c00 x1875523773101952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639388 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639388.853758:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639373/real 1788639373] req@ffff9ae342fc0380 x1875523773102080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639388 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639388.853769:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae342fc0380 x1875523773102080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639388 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788639388.853793:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae34b10d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788639388.853821:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788639388.853826:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773101952:0@lo:8:kworker.0 00000100:00080000:3.0:1788639388.853832:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae37f752800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788639388.853838:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788639388.853842:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773102080:0@lo:8:kworker.0 00000100:00080000:1.0:1788639388.854046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639388.854052:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788639388.854055:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae34b10d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788639388.854060:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 632 00000100:00080000:1.0:1788639388.854083:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788639388.854090:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae34b10d800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639388.854115:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375c49c00 x1875523773111296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788639388.854130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639388.854132:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788639388.854134:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae37f752800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788639388.854137:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 632 00000100:00080000:1.0:1788639388.854140:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788639388.854143:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae37f752800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639388.854156:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375c48380 x1875523773111424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788639388.854180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639388.854184:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639388.854186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639388.854190:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788639388.854221:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773111680:0@lo:400:kworker.0 00000100:00100000:1.0:1788639388.854320:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639388.854361:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788639388.854370:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773111040:0@lo:400:kworker.0 00000100:00100000:1.0:1788639388.855035:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639388.855114:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773111808:0@lo:400:kworker.0 00000100:00100000:1.0:1788639388.855173:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639388.855235:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773111168:0@lo:400:kworker.0 00000100:00100000:1.0:1788639388.855270:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639388.855294:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639388.855300:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773111552:0@lo:400:kworker.0 00000100:00100000:1.0:1788639388.855322:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639388.855361:0:23543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773111680 00000100:00100000:0.0:1788639388.855369:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773111040 00000100:00100000:1.0:1788639388.855370:0:23543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773111680 00000100:00100000:0.0:1788639388.855391:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773111040 00000100:00100000:0.0:1788639388.855453:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788639388.855464:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+18:3643:x1875523773111040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639388.855541:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+18:3643:x1875523773111040:12345-0@lo:400:kworker.0 Request processed in 79us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639388.855548:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788639388.855999:0:23543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773111168 00000100:00100000:1.0:1788639388.856018:0:23543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773111168 00000100:00100000:1.0:1788639388.856048:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788639388.856056:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773111680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639388.856112:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773111680:12345-0@lo:400:kworker.0 Request processed in 56us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639388.856119:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788639388.856135:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788639388.856141:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773111168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639388.856182:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773111168:12345-0@lo:400:kworker.0 Request processed in 41us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639388.856188:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788639388.856211:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773111808 00000100:00100000:1.0:1788639388.856215:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773111808 00000100:00100000:0.0:1788639388.856240:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773111552 00000100:00100000:0.0:1788639388.856249:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773111552 00000100:00100000:1.0:1788639388.857053:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788639388.857070:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773111808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639388.857109:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773111808:12345-0@lo:400:kworker.0 Request processed in 46us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639388.858767:0:22802:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788639388.858788:0:22802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788639388.860313:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773111040:0@lo:400:kworker.0 00010000:00080000:3.0:1788639388.860350:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae375c4aa00 x1875523773111808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639388.860378:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773111808:0@lo:400:kworker.0 00000100:00100000:3.0:1788639388.860395:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773111680:0@lo:400:kworker.0 00000100:00100000:0.0:1788639388.861143:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773111168:0@lo:400:kworker.0 00000100:00100000:0.0:1788639388.861182:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773111296:0@lo:8:kworker.0 00000400:00000100:0.0:1788639388.861241:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773111296 offset 0 length 520: 4 00000100:00100000:0.0:1788639388.861541:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773111424:0@lo:8:kworker.0 00000400:00000100:0.0:1788639388.861722:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773111424 offset 0 length 520: 4 00000100:00100000:0.0:1788639388.861814:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788639388.861829:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773111552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639388.861900:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773111552:12345-0@lo:400:kworker.0 Request processed in 77us (6577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639388.861907:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788639388.861952:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae375c4a300 x1875523773111552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639388.861964:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773111552:0@lo:400:kworker.0 00000100:00100000:1.0:1788639388.869139:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788639389.556930:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639390.584070:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788639390.847304:0:24306:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788639390.847308:0:24306:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788639390.847315:0:24306:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788639390.847429:0:24306:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae343ebc800 00000020:01000004:2.0:1788639390.847445:0:24306:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788639390.847459:0:24306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788639390.847473:0:24306:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ae36d183380) 00000020:00000080:2.0:1788639390.847489:0:24306:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000100:00100000:1.0:1788639390.901814:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773111936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639390.901892:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639390.902073:0:23543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773111936 00000100:00100000:0.0:1788639390.902081:0:23543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773111936 00000100:00100000:0.0:1788639390.902128:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788639390.902136:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773111936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788639390.902167:0:23543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788639390.902208:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773111936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639390.902215:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788639390.902300:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773111936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639390.902810:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773112064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639390.902846:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639390.903093:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773112064 00000100:00100000:0.0:1788639390.903100:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773112064 00000100:00100000:0.0:1788639390.903137:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788639390.903144:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773112064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788639390.903167:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788639390.903216:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773112064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639390.903222:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788639390.903326:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773112064:0@lo:41:osp-pre-0-1.0 00100000:10000000:0.0:1788639390.913119:0:24306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788639390.915046:0:24306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788639390.916759:0:24306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788639390.917084:0:24306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788639390.917606:0:24306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788639390.917966:0:24306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788639390.918239:0:24306:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1788639390.926609:0:24306:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788639390.927019:0:24306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788639390.927032:0:24306:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788639390.927044:0:24306:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x25c454990262dd2d 00000020:01000004:1.0:1788639390.927051:0:24306:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788639390.927071:0:24306:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788639390.927074:0:24306:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788639390.927080:0:24306:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788639390.927084:0:24306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788639390.927095:0:24306:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ae242f40000) 00000020:00000080:1.0:1788639390.927107:0:24306:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788639390.931771:0:24306:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788639390.931933:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788639390.931939:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788639390.934656:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788639390.934667:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788639390.936397:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788639390.936410:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788639390.939966:0:24306:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788639390.940270:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788639390.940278:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788639390.941933:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788639390.941945:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788639390.963912:0:24306:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788639390.964205:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788639390.964212:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788639390.966088:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788639390.966100:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788639390.969162:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788639390.969177:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788639390.972795:0:24306:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788639390.972990:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788639390.973010:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788639390.975064:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788639390.975076:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788639391.001429:0:24306:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788639391.001955:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788639391.001962:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788639391.004377:0:24306:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788639391.004391:0:24306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788639391.005403:0:24306:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788639391.005431:0:24306:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788639391.005437:0:24306:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788639391.039524:0:24306:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788639391.039562:0:24306:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.118@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788639391.039567:0:24306:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788639391.039568:0:24306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788639391.039570:0:24306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788639391.039571:0:24306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788639391.039572:0:24306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788639391.039574:0:24306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788639391.039575:0:24306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788639391.039577:0:24306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788639391.039578:0:24306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788639391.039582:0:24306:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788639391.039584:0:24306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788639391.039585:0:24306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788639391.039586:0:24306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788639391.039588:0:24306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788639391.039589:0:24306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788639391.039590:0:24306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788639391.039591:0:24306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788639391.039592:0:24306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788639391.039593:0:24306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788639391.039653:0:24306:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788639391.039675:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112192:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788639391.039758:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639391.039791:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343e8bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639391.040003:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773112192 00000100:00100000:1.0:1788639391.040011:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773112192 00000100:00100000:1.0:1788639391.040065:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788639391.040075:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+18:24306:x1875523773112192:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788639391.040103:0:22794:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788639391.040106:0:22794:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788639391.040110:0:22794:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788639391.040578:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+18:24306:x1875523773112192:12345-0@lo:253:mount.lustre.0 Request processed in 502us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639391.040586:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788639391.040753:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112192:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788639391.040764:0:24306:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788639391.040767:0:24306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788639391.040768:0:24306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788639391.040770:0:24306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788639391.040771:0:24306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788639391.040771:0:24306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788639391.040773:0:24306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788639391.040774:0:24306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788639391.040775:0:24306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788639391.040776:0:24306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788639391.040793:0:24306:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae343ebc800 from lustre-OST0000 10000000:01000000:2.0:1788639391.040819:0:24306:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788639391.040822:0:24306:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788639391.040829:0:24306:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae37724b380 local copy 00010000:00010000:2.0:1788639391.040838:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639391.040913:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639391.040943:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639391.040969:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343e8bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639391.041101:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773112320 00000100:00100000:0.0:1788639391.041106:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773112320 00000100:00100000:0.0:1788639391.041140:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788639391.041148:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+18:24306:x1875523773112320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639391.041212:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+18:24306:x1875523773112320:12345-0@lo:501:mount.lustre.0 Request processed in 65us (268us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788639391.041219:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788639391.041398:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112320:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788639391.041410:0:24306:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788639391.041427:0:24306:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788639391.041432:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.041441:0:24306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639391.041463:0:24306:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae343ebc800 10000000:01000000:3.0:1788639391.041467:0:24306:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788639391.041471:0:24306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788639391.041474:0:24306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788639391.041478:0:24306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788639391.041480:0:24306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788639391.041510:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262dd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.041517:0:24306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262dd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.041539:0:24306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262dd3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639391.041552:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788639391.041579:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639391.041601:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3802080c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639391.041749:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773112448 00000100:00100000:1.0:1788639391.041755:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773112448 00000100:00100000:1.0:1788639391.041776:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788639391.041783:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+18:24306:x1875523773112448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639391.041791:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639391.041802:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f9600/0x25c454990262dd42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dd3b expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639391.041822:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f9600/0x25c454990262dd42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dd3b expref: 19 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639391.041831:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f9600/0x25c454990262dd42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dd3b expref: 19 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639391.041839:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9600, rc 0) 00000100:00100000:1.0:1788639391.041875:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+19:24306:x1875523773112448:12345-0@lo:101:mount.lustre.0 Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639391.041881:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788639391.042048:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639391.042059:0:24306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262dd3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd42 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.042068:0:24306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262dd3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dd42 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639391.043397:0:24306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788639391.047704:0:24306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788639391.049907:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788639391.049956:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788639391.049976:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788639391.049990:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788639391.050018:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788639391.050032:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788639391.050047:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788639391.050061:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788639391.050088:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788639391.050102:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788639391.050113:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788639391.050124:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788639391.050143:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788639391.050148:0:24306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788639391.050258:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639391.050316:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639391.050472:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3802086c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639391.054748:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773112576 00000100:00100000:1.0:1788639391.054764:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773112576 00000100:00100000:1.0:1788639391.054824:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788639391.054849:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+19:24306:x1875523773112576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639391.055174:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+19:24306:x1875523773112576:12345-0@lo:501:mount.lustre.0 Request processed in 326us (4856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639391.055182:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788639391.055584:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639391.055788:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639391.055841:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639391.055880:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343e8b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788639391.055942:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773112704 00000100:00100000:0.0:1788639391.055947:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773112704 00000100:00100000:0.0:1788639391.055982:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788639391.055989:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+19:24306:x1875523773112704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639391.056934:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+19:24306:x1875523773112704:12345-0@lo:503:mount.lustre.0 Request processed in 944us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639391.056942:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788639391.057039:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112704:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788639391.057457:0:24306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788639391.057562:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639391.057604:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639391.057659:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b1b6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639391.057829:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773112832 00000100:00100000:0.0:1788639391.057835:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773112832 00000100:00100000:0.0:1788639391.057874:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788639391.057882:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+19:24306:x1875523773112832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639391.058322:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+19:24306:x1875523773112832:12345-0@lo:502:mount.lustre.0 Request processed in 437us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639391.058329:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788639391.058519:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639391.058746:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788639391.058773:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788639391.058785:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788639391.058795:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788639391.058807:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788639391.058818:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788639391.058831:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788639391.058842:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788639391.058854:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788639391.058865:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788639391.058890:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788639391.058904:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788639391.058931:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639391.058970:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639391.059003:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b1b6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639391.059106:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773112960 00000100:00100000:0.0:1788639391.059112:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773112960 00000100:00100000:0.0:1788639391.059152:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788639391.059166:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+19:24306:x1875523773112960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639391.059260:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+19:24306:x1875523773112960:12345-0@lo:502:mount.lustre.0 Request processed in 95us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639391.059267:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788639391.060551:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773112960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639391.060645:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788639391.060666:0:24306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788639391.062439:0:24323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788639391.062449:0:24323:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788639391.062456:0:24323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639391.062459:0:24323:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788639391.062465:0:24323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788639391.062480:0:24323:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ae242f44d40) 00000020:00000080:1.0:1788639391.062517:0:24323:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788639391.062526:0:24323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788639391.062590:0:24323:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae343ebc800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788639391.062598:0:24323:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788639391.062606:0:24323:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x25c454990262dd50 00010000:00010000:2.0:1788639391.068683:0:24323:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788639391.070962:0:24323:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1788639391.072971:0:24323:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788639391.076371:0:24323:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788639391.076387:0:24323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639391.076395:0:24323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.076397:0:24323:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788639391.076469:0:24323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788639391.076474:0:24323:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788639391.076475:0:24323:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788639391.076477:0:24323:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788639391.076479:0:24323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788639391.076483:0:24323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.076485:0:24323:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788639391.076488:0:24323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639391.076491:0:24323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.076492:0:24323:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788639391.076505:0:24323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788639391.076507:0:24323:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788639391.076510:0:24323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639391.076512:0:24323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.076514:0:24323:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788639391.076516:0:24323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639391.076518:0:24323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.076520:0:24323:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788639391.076523:0:24323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788639391.076556:0:24323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639391.076559:0:24323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.076560:0:24323:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788639391.076564:0:24323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788639391.076931:0:24306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788639391.076961:0:24306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788639391.076985:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262dd3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd42 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639391.077009:0:24306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262dd3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd42 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639391.077018:0:24306:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae343ebc800 from 1 10000000:01000000:1.0:1788639391.077020:0:24306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788639391.077055:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639391.077063:0:24306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639391.077073:0:24306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639391.077096:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788639391.077171:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639391.077211:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773113088 00000100:00100000:1.0:1788639391.077220:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773113088 00000100:00100000:1.0:1788639391.077279:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788639391.077288:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+19:24306:x1875523773113088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639391.077301:0:22795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639391.077315:0:22795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f8c00/0x25c454990262dd5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dd57 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639391.077338:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f8c00/0x25c454990262dd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dd57 expref: 20 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639391.077349:0:22795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f8c00/0x25c454990262dd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dd57 expref: 20 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639391.077358:0:22795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8c00, rc 0) 00000100:00100000:1.0:1788639391.077388:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+20:24306:x1875523773113088:12345-0@lo:101:mount.lustre.0 Request processed in 101us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639391.077395:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788639391.077451:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b1b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788639391.077471:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639391.077486:0:24306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639391.077495:0:24306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788639391.080966:0:24306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788639391.082390:0:24306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788639391.089738:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788639391.090726:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788639391.090758:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788639391.090849:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788639391.090869:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788639391.090882:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788639391.090894:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788639391.090905:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788639391.090916:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788639391.090927:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788639391.090937:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788639391.090965:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788639391.090971:0:24306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788639391.091084:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639391.091145:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639391.091190:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788639391.091275:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773113216 00000100:00100000:3.0:1788639391.091284:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773113216 00000100:00100000:3.0:1788639391.091336:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788639391.091346:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+20:24306:x1875523773113216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639391.091648:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+20:24306:x1875523773113216:12345-0@lo:501:mount.lustre.0 Request processed in 303us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639391.091656:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788639391.091885:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639391.091919:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639391.091960:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639391.092446:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788639391.093194:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773113344 00000100:00100000:1.0:1788639391.093202:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773113344 00000100:00100000:1.0:1788639391.093278:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788639391.093288:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+20:24306:x1875523773113344:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639391.093413:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+20:24306:x1875523773113344:12345-0@lo:503:mount.lustre.0 Request processed in 118us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639391.093420:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788639391.093490:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113344:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788639391.093937:0:24306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788639391.094021:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639391.094064:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639391.094786:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639391.094910:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773113472 00000100:00100000:2.0:1788639391.094917:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773113472 00000100:00100000:2.0:1788639391.094950:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788639391.094958:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+20:24306:x1875523773113472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639391.095081:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+20:24306:x1875523773113472:12345-0@lo:502:mount.lustre.0 Request processed in 123us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639391.095089:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788639391.095206:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113472:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788639391.095389:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788639391.095489:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788639391.095580:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788639391.095606:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788639391.095704:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788639391.095720:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788639391.095734:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788639391.095748:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788639391.095761:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788639391.095861:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788639391.095877:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788639391.095904:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639391.095943:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639391.096010:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788639391.096146:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773113600 00000100:00100000:3.0:1788639391.096152:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773113600 00000100:00100000:2.0:1788639391.096201:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788639391.096210:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+20:24306:x1875523773113600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639391.096299:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+20:24306:x1875523773113600:12345-0@lo:502:mount.lustre.0 Request processed in 90us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639391.096306:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788639391.096374:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788639391.096425:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788639391.096433:0:24306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788639391.097917:0:24327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639391.097929:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.097932:0:24327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788639391.097938:0:24327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae343ebc800 00000020:00000080:0.0:1788639391.097941:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788639391.097948:0:24327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639391.097950:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.097951:0:24327:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788639391.097953:0:24327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639391.097955:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.097967:0:24327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788639391.097971:0:24327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae343ebc800 00000020:00000080:0.0:1788639391.097973:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788639391.098037:0:24327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639391.098041:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.098042:0:24327:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788639391.098045:0:24327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639391.098054:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.098055:0:24327:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788639391.098060:0:24327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae343ebc800 00000020:00000080:0.0:1788639391.098062:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788639391.098079:0:24327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639391.098081:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.098083:0:24327:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788639391.098085:0:24327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639391.098087:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.098088:0:24327:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788639391.098091:0:24327:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae343ebc800 00000020:00000080:0.0:1788639391.098093:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788639391.098112:0:24327:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639391.098115:0:24327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639391.098116:0:24327:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788639391.098119:0:24327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788639391.103573:0:24306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788639391.103647:0:24306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639391.103667:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639391.103681:0:24306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639391.103758:0:24306:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788639391.103761:0:24306:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae343ebc800 10000000:01000000:2.0:1788639391.103764:0:24306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae343ebc800 10000000:01000000:2.0:1788639391.103768:0:24306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788639391.103786:0:24306:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae343ebc800 from 1 10000000:01000000:2.0:1788639391.103789:0:24306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788639391.103822:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22e00/0x25c454990262dd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639391.103836:0:24306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f22e00/0x25c454990262dd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639391.103847:0:24306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f22e00/0x25c454990262dd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639391.103872:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788639391.103933:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639391.103978:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343e8bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788639391.105914:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773113728 00000100:00100000:3.0:1788639391.105924:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773113728 00000100:00100000:3.0:1788639391.105957:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788639391.105966:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+20:24306:x1875523773113728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639391.105981:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639391.106006:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f9f800/0x25c454990262dd6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dd65 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.106030:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f9f800/0x25c454990262dd6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dd65 expref: 21 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.106040:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f9f800/0x25c454990262dd6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dd65 expref: 21 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.106048:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9f800, rc 0) 00000100:00100000:3.0:1788639391.106104:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773113728:12345-0@lo:101:mount.lustre.0 Request processed in 139us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639391.106119:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788639391.106924:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639391.106945:0:24306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f22e00/0x25c454990262dd65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd6c expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639391.106956:0:24306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f22e00/0x25c454990262dd65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dd6c expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639391.110890:0:24306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788639391.111182:0:24306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788639391.111355:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788639391.111376:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788639391.111388:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788639391.111399:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788639391.112758:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788639391.112790:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788639391.112806:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788639391.112819:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788639391.112832:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788639391.112843:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788639391.112856:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788639391.112870:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788639391.112884:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788639391.112898:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788639391.112912:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788639391.112927:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788639391.112959:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788639391.112976:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788639391.112989:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788639391.113014:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788639391.113028:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788639391.113039:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788639391.113051:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788639391.113063:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788639391.113074:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788639391.113084:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788639391.113096:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788639391.113110:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788639391.113134:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788639391.113147:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788639391.113161:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788639391.113174:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788639391.113199:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788639391.113213:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788639391.113226:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788639391.113237:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788639391.113250:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788639391.113263:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788639391.113276:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788639391.113291:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788639391.113306:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788639391.113320:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788639391.113334:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788639391.113347:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788639391.113360:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788639391.113374:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788639391.113387:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788639391.113412:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788639391.115702:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788639391.115758:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788639391.116765:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788639391.116849:0:24306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788639391.116950:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639391.117024:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639391.117107:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3802080c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639391.123673:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773113856 00000100:00100000:2.0:1788639391.123687:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773113856 00000100:00100000:2.0:1788639391.123750:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788639391.123760:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773113856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639391.125033:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773113856:12345-0@lo:501:mount.lustre.0 Request processed in 1271us (8005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639391.125044:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788639391.125161:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639391.125205:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639391.125249:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639391.125293:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3802080c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639391.125337:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773113984 00000100:00100000:2.0:1788639391.125342:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773113984 00000100:00100000:2.0:1788639391.125376:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788639391.125383:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773113984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639391.125966:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773113984:12345-0@lo:503:mount.lustre.0 Request processed in 581us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639391.125974:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788639391.126929:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773113984:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788639391.127357:0:24306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788639391.128683:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773114112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639391.128756:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639391.128879:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773114112 00000100:00100000:2.0:1788639391.128886:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773114112 00000100:00100000:2.0:1788639391.128931:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788639391.128940:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773114112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639391.129065:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773114112:12345-0@lo:502:mount.lustre.0 Request processed in 125us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639391.129073:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788639391.129570:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3802080c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639391.129593:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773114112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788639391.131032:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788639391.131071:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788639391.131089:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788639391.131106:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788639391.131121:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788639391.131136:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788639391.131151:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788639391.131171:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788639391.131203:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788639391.131220:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788639391.131236:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788639391.131250:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788639391.131263:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788639391.131276:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788639391.131288:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788639391.131299:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788639391.131310:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788639391.131324:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788639391.131336:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788639391.131349:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788639391.131363:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788639391.131378:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788639391.131392:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788639391.131434:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788639391.131463:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788639391.131481:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788639391.132525:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788639391.132567:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788639391.132593:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788639391.132609:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788639391.132637:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788639391.132653:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788639391.132687:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788639391.132701:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788639391.132713:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788639391.132738:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788639391.132754:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788639391.132772:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788639391.132786:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788639391.132811:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788639391.132850:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788639391.132869:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788639391.132884:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788639391.132896:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788639391.132908:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788639391.132920:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788639391.132933:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788639391.132947:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788639391.133015:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773114240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639391.133094:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639391.133148:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3802080c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639391.133262:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773114240 00000100:00100000:2.0:1788639391.133270:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773114240 00000100:00100000:2.0:1788639391.133325:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788639391.133336:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773114240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639391.133612:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773114240:12345-0@lo:502:mount.lustre.0 Request processed in 278us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639391.133648:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788639391.133669:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773114240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788639391.134347:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788639391.134382:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788639391.134418:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773114368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639391.134462:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639391.134506:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3802080c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639391.134793:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773114368 00000100:00100000:3.0:1788639391.134800:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773114368 00000100:00100000:3.0:1788639391.134832:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788639391.134839:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773114368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639391.134932:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773114368:12345-0@lo:502:mount.lustre.0 Request processed in 92us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639391.134939:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788639391.134983:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773114368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788639391.135103:0:24306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788639391.135112:0:24306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788639391.136403:0:24332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788639391.136416:0:24332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ae3691c8000) 00000020:00000080:3.0:1788639391.136433:0:24332:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788639391.136564:0:24332:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae343ebc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788639391.136568:0:24332:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae343ebc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788639391.136570:0:24332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae343ebc800 3 00010000:00080000:3.0:1788639391.136603:0:24332:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae242335000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788639391.138860:0:24332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788639391.139075:0:24332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788639391.139118:0:24332:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788639391.139130:0:24332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x25c454990262dd7a 00000100:00080000:3.0:1788639391.139140:0:24332:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788639391.139146:0:24332:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ae242335000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639391.139180:0:24332:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc1500 x1875523773114496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639391.139226:0:24332:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788639391.139268:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523773114496:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788639391.139445:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639391.139506:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773114496 00000100:00100000:1.0:1788639391.139513:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773114496 00000100:00100000:1.0:1788639391.139552:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788639391.139560:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523773114496:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788639391.139581:0:22802:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:1.0:1788639391.139609:0:22802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x25c454990262dd81 00000004:00100000:1.0:1788639391.139642:0:22802:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788639391.139671:0:22802:0:(import.c:65:import_set_state_nolock()) ffff9ae243034800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639391.139733:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875523773114496:12345-0@lo:38:llog_process_th.0 Request processed in 172us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639391.139740:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788639391.139773:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae342fc1500 x1875523773114496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639391.139783:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639391.139790:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788639391.139811:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788639391.139823:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788639391.139826:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae242335000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788639391.139833:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523773114496:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1788639391.140138:0:24332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788639391.140150:0:24332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ae3691cb380) 00000020:00000080:3.0:1788639391.140165:0:24332:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00080000:2.0:1788639391.140218:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639391.140233:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788639391.140236:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639391.140239:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:3.0:1788639391.140257:0:24332:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae343ebc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788639391.140262:0:24332:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae343ebc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788639391.140266:0:24332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae343ebc800 3 00000100:00080000:2.0:1788639391.140276:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639391.140282:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788639391.140283:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773114624:0@lo:400:kworker.0 00000100:00080000:2.0:1788639391.140286:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639391.140296:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788639391.140318:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639391.140344:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639391.140350:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773114752:0@lo:400:kworker.0 00000100:00100000:3.0:1788639391.140372:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639391.140406:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773114624 00000100:00100000:3.0:1788639391.140411:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773114624 00000100:00100000:3.0:1788639391.140438:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773114752 00000100:00100000:3.0:1788639391.140441:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773114752 00000100:00100000:3.0:1788639391.140462:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788639391.140470:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773114624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639391.140511:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773114624:12345-0@lo:400:kworker.0 Request processed in 42us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639391.140517:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788639391.140528:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788639391.140534:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773114752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639391.140555:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773114752:12345-0@lo:400:kworker.0 Request processed in 22us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639391.140561:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788639391.140596:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2432cb100 x1875523773114752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639391.140607:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773114752:0@lo:400:kworker.0 00010000:00080000:3.0:1788639391.140644:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2432c8000 x1875523773114624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639391.140654:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773114624:0@lo:400:kworker.0 00010000:00080000:3.0:1788639391.140716:0:24332:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae242331800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788639391.142441:0:24332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788639391.142648:0:24332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788639391.142689:0:24332:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788639391.142701:0:24332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x25c454990262dd8f 00000100:00080000:3.0:1788639391.142712:0:24332:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788639391.142718:0:24332:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9ae242331800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639391.142750:0:24332:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc2300 x1875523773114880/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788639391.142794:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875523773114880:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788639391.142860:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639391.144380:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773114880 00000100:00080000:3.0:1788639391.144388:0:24332:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788639391.144391:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773114880 00000100:00080000:3.0:1788639391.144411:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639391.144416:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639391.144418:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639391.144422:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788639391.144424:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788639391.144426:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1788639391.144431:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875523773114880:12345-0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788639391.144436:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639391.144439:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639391.144442:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:1.0:1788639391.144456:0:22804:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:1.0:1788639391.144505:0:22804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x25c454990262dd96 00000004:00100000:1.0:1788639391.144519:0:22804:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788639391.144555:0:22804:0:(import.c:65:import_set_state_nolock()) ffff9ae243037800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639391.144642:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875523773114880:12345-0@lo:38:llog_process_th.0 Request processed in 209us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639391.144650:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788639391.144743:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae342fc2300 x1875523773114880/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639391.144754:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788639391.144763:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788639391.144771:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788639391.144776:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788639391.144778:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae242331800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788639391.144785:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875523773114880:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788639391.146206:0:24332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788639391.146553:0:24306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788639391.146583:0:24306:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788639391.146598:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22e00/0x25c454990262dd65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd6c expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639391.146610:0:24306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f22e00/0x25c454990262dd65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dd6c expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788639391.146691:0:24306:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788639391.146694:0:24306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788639391.146695:0:24306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639391.146696:0:24306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639391.146697:0:24306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639391.146698:0:24306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639391.146699:0:24306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788639391.146701:0:24306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639391.146702:0:24306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788639391.146706:0:24306:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788639391.146711:0:24306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788639391.146713:0:24306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788639391.146714:0:24306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639391.146715:0:24306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639391.146716:0:24306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639391.146717:0:24306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639391.146718:0:24306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788639391.146719:0:24306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639391.146719:0:24306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788639391.146739:0:24306:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788639391.146756:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773115008:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788639391.146824:0:24306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639391.146858:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639391.147212:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773115008 00000100:00100000:2.0:1788639391.147219:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773115008 00000100:00100000:2.0:1788639391.147271:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788639391.147280:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+21:24306:x1875523773115008:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788639391.147307:0:22794:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788639391.147320:0:22794:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788639391.155802:0:22794:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788639391.155842:0:22794:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788639391.155981:0:22818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788639391.155986:0:22818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788639391.156017:0:22818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.156035:0:22818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2421f9e00/0x25c454990262dce7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dce0 expref: 21 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.156043:0:22818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f23800/0x25c454990262dcf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dcee expref: 21 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.156050:0:22818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.156248:0:22818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f23800/0x25c454990262dcf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262dcee expref: 21 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.156266:0:22818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae242f23800/0x25c454990262dcf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262dcee expref: 21 pid: 22796 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639391.156399:0:22818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773115136:0@lo:104: 00000100:00100000:3.0:1788639391.156457:0:22818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788639391.156502:0:22818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2421f9e00/0x25c454990262dce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262dce0 expref: 21 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.156509:0:22818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2421f9e00/0x25c454990262dce7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262dce0 expref: 21 pid: 22794 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639391.156516:0:22818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773115264:0@lo:104: 00000100:00100000:3.0:1788639391.156790:0:22818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639391.156812:0:22818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639391.156834:0:22786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788639391.156850:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773115136 00000100:00100000:3.0:1788639391.156856:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773115136 00000100:00100000:3.0:1788639391.156885:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773115264 00000100:00100000:3.0:1788639391.156887:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773115264 00000100:00100000:3.0:1788639391.156902:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788639391.156909:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+4:22818:x1875523773115136:12345-0@lo:104: 00010000:00010000:3.0:1788639391.156920:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157029:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788639391.157036:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+4:22818:x1875523773115136:12345-0@lo:104: Request processed in 127us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639391.157043:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788639391.157080:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788639391.157088:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3697ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+3:22818:x1875523773115264:12345-0@lo:104: 00010000:00010000:3.0:1788639391.157095:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157135:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788639391.157140:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3697ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+3:22818:x1875523773115264:12345-0@lo:104: Request processed in 54us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639391.157145:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788639391.157184:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788639391.157190:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157196:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e200 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639391.157200:0:22791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157208:0:22791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639391.157215:0:22791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639391.157221:0:22791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788639391.157244:0:22791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157250:0:22791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639391.157266:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157295:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dcee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dcf5 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157306:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639391.157316:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157322:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23e00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639391.157325:0:22791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157331:0:22791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639391.157337:0:22791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639391.157341:0:22791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788639391.157354:0:22791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157360:0:22791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639391.157366:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157371:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262dce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dce7 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157381:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639391.157387:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639391.157389:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639391.157395:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639391.157414:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773115392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639391.157438:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639391.157464:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639391.157469:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773115520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639391.157486:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639391.157517:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773115392 00000100:00100000:3.0:1788639391.157520:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773115392 00010000:00010000:3.0:1788639391.157534:0:22789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f23800/0x25c454990262dcf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dcee expref: 22 pid: 22796 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639391.157551:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773115520 00000100:00100000:1.0:1788639391.157558:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773115520 00000100:00100000:3.0:1788639391.157570:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788639391.157577:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2421f9e00/0x25c454990262dce7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dce0 expref: 23 pid: 22794 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639391.157580:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a452a6f1-70bc-4918-a445-81111879f6e1+23:3641:x1875523773115392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639391.157595:0:22789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639391.157601:0:22789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f23800/0x25c454990262dcf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dcee expref: 23 pid: 22796 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639391.157604:0:22788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788639391.157640:0:22788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788639391.157642:0:22789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f23800/0x25c454990262dcf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262dcee expref: 23 pid: 22796 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157658:0:22789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639391.157682:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a452a6f1-70bc-4918-a445-81111879f6e1+23:3641:x1875523773115392:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639391.157688:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788639391.157700:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788639391.157706:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a452a6f1-70bc-4918-a445-81111879f6e1+22:3641:x1875523773115520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639391.157713:0:22789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639391.157723:0:22789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2421f9e00/0x25c454990262dce7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dce0 expref: 22 pid: 22794 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157731:0:22789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2421f9e00/0x25c454990262dce7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262dce0 expref: 22 pid: 22794 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157741:0:22789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157748:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788639391.157759:0:22789:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009072010s 00010000:00010000:3.0:1788639391.157762:0:22789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157769:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157775:0:22789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157781:0:22789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157786:0:22789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9fc00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639391.157790:0:22789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157797:0:22789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157803:0:22789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639391.157815:0:22789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639391.157836:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a452a6f1-70bc-4918-a445-81111879f6e1+22:3641:x1875523773115520:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639391.157842:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788639391.157965:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773115520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639391.157974:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773115392:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639391.158560:0:22818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f23800/0x25c454990262dcf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262dcee expref: 21 pid: 22796 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639391.158571:0:22818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773115136:0@lo:104: 00010000:00010000:2.0:1788639391.158581:0:22818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2421f9e00/0x25c454990262dce7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262dce0 expref: 20 pid: 22794 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639391.158588:0:22818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773115264:0@lo:104: 00010000:00010000:2.0:1788639391.158604:0:22818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639391.158611:0:22818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639391.158653:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+19:24306:x1875523773115008:12345-0@lo:253:mount.lustre.0 Request processed in 11372us (11826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639391.158664:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788639391.158669:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:24306:1875523773115008:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788639391.158686:0:24306:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788639391.158690:0:24306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788639391.158692:0:24306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788639391.158693:0:24306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639391.158695:0:24306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639391.158696:0:24306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639391.158697:0:24306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639391.158699:0:24306:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788639391.158701:0:24306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639391.158702:0:24306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788639391.158715:0:24306:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788639391.158728:0:22818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639391.158734:0:22818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f9fc00/0x25c454990262dd9d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788639391.164945:0:24306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788639391.172470:0:24306:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788639391.172480:0:24306:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788639391.172530:0:24306:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788639391.172569:0:24306:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788639391.172597:0:24306:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788639391.172753:0:24306:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788639391.173583:0:24306:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788639391.173820:0:24306:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788639391.610412:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788639391.841101:0:24387:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788639391.841331:0:24387:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788639392.437176:0:22799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788639392.437182:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae342c41800 from 13 10000000:01000000:3.0:1788639392.437187:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788639392.437231:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639392.437243:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639392.437255:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639392.437281:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773115648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639392.437366:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639392.437413:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242351f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639392.437472:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773115648 00000100:00100000:1.0:1788639392.437479:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773115648 00000100:00100000:1.0:1788639392.437531:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788639392.437541:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+19:22799:x1875523773115648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639392.437554:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639392.437568:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f9c00/0x25c454990262ddab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262dda4 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639392.437591:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f9c00/0x25c454990262ddab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262dda4 expref: 20 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639392.437602:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f9c00/0x25c454990262ddab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dda4 expref: 20 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639392.437610:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9c00, rc 0) 00000100:00100000:1.0:1788639392.437685:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+20:22799:x1875523773115648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639392.437692:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788639392.438701:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773115648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639392.438723:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639392.438735:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639392.438813:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773115776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788639392.438861:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639392.438889:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24202fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639392.439741:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773115776 00000100:00100000:1.0:1788639392.439750:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773115776 00000100:00100000:1.0:1788639392.439814:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788639392.439823:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+20:22799:x1875523773115776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788639392.439840:0:22794:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788639392.439855:0:22794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788639392.439862:0:22794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788639392.439968:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+20:22799:x1875523773115776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639392.439976:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788639392.440065:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773115776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788639392.440126:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788639392.440134:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639392.440144:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639392.440162:0:22799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788639392.440164:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae36cf54000 from 13 10000000:01000000:0.0:1788639392.440167:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788639392.440192:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639392.440200:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639392.440208:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639392.440365:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773115904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639392.440396:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639392.440427:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae367c9dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639392.440495:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773115904 00000100:00100000:1.0:1788639392.440500:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773115904 00000100:00100000:1.0:1788639392.440524:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788639392.440530:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+20:22799:x1875523773115904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639392.440539:0:22795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639392.440550:0:22795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f9e00/0x25c454990262ddb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262ddb2 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639392.440567:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f9e00/0x25c454990262ddb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262ddb2 expref: 21 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639392.440576:0:22795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f9e00/0x25c454990262ddb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262ddb2 expref: 21 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639392.440583:0:22795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9e00, rc 0) 00000100:00100000:1.0:1788639392.440611:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+21:22799:x1875523773115904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639392.440639:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788639392.440670:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773115904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639392.440681:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639392.440689:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639392.440738:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773116032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788639392.440766:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639392.440785:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3451d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639392.440796:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773116032 00000100:00100000:1.0:1788639392.440799:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773116032 00000100:00100000:1.0:1788639392.440819:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788639392.440824:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+21:22799:x1875523773116032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788639392.441278:0:22795:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788639392.441296:0:22795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788639392.441299:0:22795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788639392.441387:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+21:22799:x1875523773116032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 561us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639392.441394:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788639392.441812:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773116032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788639392.441865:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788639392.441873:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639392.441882:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639392.630295:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639393.656975:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639394.676816:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788639395.061298:0:22838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788639395.700727:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639396.021068:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773116160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639396.021132:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639396.021192:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773116160 00000100:00100000:1.0:1788639396.021199:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773116160 00000100:00100000:1.0:1788639396.021241:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788639396.021250:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773116160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639396.021284:0:22807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788639396.021328:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773116160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639396.021335:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788639396.021381:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773116160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639396.022045:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773116288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639396.022084:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639396.022262:0:23543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773116288 00000100:00100000:2.0:1788639396.022267:0:23543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773116288 00000100:00100000:2.0:1788639396.022296:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788639396.022303:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773116288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639396.022324:0:23543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788639396.022368:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773116288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639396.022374:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788639396.022441:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773116288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639396.544845:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773116416:0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.544911:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639396.544989:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773116416 00000100:00100000:1.0:1788639396.544996:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773116416 00000100:00100000:1.0:1788639396.545038:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788639396.545046:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+21:3641:x1875523773116416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.545093:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+21:3641:x1875523773116416:12345-0@lo:400:kworker.0 Request processed in 48us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639396.545100:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788639396.545147:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773116416:0@lo:400:kworker.0 00000100:00080000:1.0:1788639396.545178:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639396.545182:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639396.545184:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639396.545187:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788639396.545194:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773116544:0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.545223:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639396.545260:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773116544 00000100:00100000:1.0:1788639396.545264:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773116544 00000100:00100000:1.0:1788639396.545298:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788639396.545305:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773116544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.545347:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773116544:12345-0@lo:400:kworker.0 Request processed in 42us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639396.545353:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788639396.545395:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773116544:0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.545433:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773116672:0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.545460:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639396.545504:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773116672 00000100:00100000:1.0:1788639396.545508:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773116672 00000100:00100000:1.0:1788639396.546812:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788639396.546827:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773116672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.546897:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773116672:12345-0@lo:400:kworker.0 Request processed in 76us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639396.546904:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788639396.546972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639396.546977:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639396.546979:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639396.546983:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788639396.547011:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773116928:0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.547041:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639396.547083:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773116928 00000100:00100000:1.0:1788639396.547090:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773116928 00000100:00100000:1.0:1788639396.547119:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788639396.547125:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773116928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.547158:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773116928:12345-0@lo:400:kworker.0 Request processed in 33us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639396.547164:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788639396.547198:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243b14000 x1875523773116928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639396.547225:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773116928:0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.547262:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773117056:0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.547286:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639396.547311:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773117056 00000100:00100000:1.0:1788639396.547315:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773117056 00000100:00100000:1.0:1788639396.547343:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788639396.547349:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773117056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639396.547380:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773117056:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639396.547386:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788639396.547413:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788639396.547434:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243b14000 x1875523773117056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639396.547444:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773117056:0@lo:400:kworker.0 00000100:00100000:0.0:1788639396.547740:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773117184:0@lo:400:kworker.0 00000100:00100000:0.0:1788639396.547775:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788639396.547811:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243b17480 x1875523773116672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639396.547821:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773116672:0@lo:400:kworker.0 00000100:00100000:0.0:1788639396.547834:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639396.547839:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773116800:0@lo:400:kworker.0 00000100:00100000:0.0:1788639396.547865:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639396.547893:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773116800 00000100:00100000:0.0:1788639396.547897:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773116800 00000100:00100000:0.0:1788639396.547923:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788639396.547930:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773116800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639396.547976:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773116800:12345-0@lo:400:kworker.0 Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639396.547982:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788639396.548008:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773116800:0@lo:400:kworker.0 00000100:00100000:0.0:1788639396.548022:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773117184 00000100:00100000:0.0:1788639396.548025:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773117184 00000100:00100000:0.0:1788639396.548052:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788639396.548058:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773117184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639396.548090:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773117184:12345-0@lo:400:kworker.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639396.548096:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788639396.548112:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788639396.548126:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243b14000 x1875523773117184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639396.548136:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773117184:0@lo:400:kworker.0 00010000:00010000:3.0:1788639396.724991:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788639396.838583:0:24678:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1788639397.109296:0:23559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788639397.756279:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788639397.815086:0:24730:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788639397.817878:0:24730:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788639398.609601:0:24780:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788639398.609898:0:24780:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788639398.775740:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639399.797254:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639400.373299:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639385/real 1788639385] req@ffff9ae2432c9500 x1875523773110400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639400 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639400.373332:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae2432c9500 x1875523773110400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639400 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639400.373342:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639385/real 1788639385] req@ffff9ae2432cb480 x1875523773110528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639400 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639400.373354:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae2432cb480 x1875523773110528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639400 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788639400.373373:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d188000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639400.373410:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788639400.373414:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773110400:0@lo:8:kworker.0 00000100:00080000:1.0:1788639400.373420:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375f8d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639400.373425:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788639400.373428:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773110528:0@lo:8:kworker.0 00000100:00080000:3.0:1788639400.373551:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639400.373556:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639400.373559:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639400.373562:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788639400.373569:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1788639400.373576:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639400.373579:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:1.0:1788639400.373580:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773117312:0@lo:400:kworker.0 00000100:00080000:3.0:1788639400.373581:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae36d188000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639400.373586:0:13809:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 644 00000100:00080000:3.0:1788639400.373591:0:13809:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788639400.373596:0:13809:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ae36d188000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639400.373612:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc2d80 x1875523773117824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639400.373645:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639400.373648:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788639400.373650:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae375f8d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639400.373653:0:13809:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 644 00000100:00080000:3.0:1788639400.373655:0:13809:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788639400.373658:0:13809:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ae375f8d800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639400.373668:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc0700 x1875523773117952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788639400.373670:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639400.373714:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773117696:0@lo:400:kworker.0 00000100:00100000:3.0:1788639400.373717:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773117440:0@lo:400:kworker.0 00000100:00100000:1.0:1788639400.373741:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639400.373755:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773117568:0@lo:400:kworker.0 00000100:00100000:1.0:1788639400.373763:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788639400.373767:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773118080:0@lo:400:kworker.0 00000100:00100000:3.0:1788639400.373779:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639400.373796:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773117312 00000100:00100000:3.0:1788639400.373801:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523773118336:0@lo:400:kworker.0 00000100:00100000:1.0:1788639400.373803:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773117312 00000100:00100000:3.0:1788639400.373821:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639400.373842:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788639400.373844:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773117824:0@lo:8:kworker.0 00000100:00100000:1.0:1788639400.373850:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+21:3643:x1875523773117312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639400.373870:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639400.373893:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773117952:0@lo:8:kworker.0 00000100:00100000:3.0:1788639400.373914:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639400.374033:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+21:3643:x1875523773117312:12345-0@lo:400:kworker.0 Request processed in 181us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639400.374040:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788639400.374072:0:23543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773117696 00000100:00100000:1.0:1788639400.374077:0:23543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773117696 00000100:00100000:1.0:1788639400.374111:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788639400.374118:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773117696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639400.374151:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773117696:12345-0@lo:400:kworker.0 Request processed in 34us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639400.374165:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788639400.374184:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773117568 00000100:00100000:1.0:1788639400.374188:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773117568 00000100:00100000:1.0:1788639400.374219:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773118336 00000100:00100000:1.0:1788639400.374222:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773118336 00000100:00100000:1.0:1788639400.374252:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788639400.374256:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788639400.374257:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773117568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639400.374263:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523773118336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639400.374298:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773117568:12345-0@lo:400:kworker.0 Request processed in 35us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639400.374304:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788639400.374336:0:24312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773117824 00000100:00100000:1.0:1788639400.374340:0:24312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773117824 00000100:00100000:1.0:1788639400.374356:0:24312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773117952 00000100:00100000:1.0:1788639400.374358:0:24312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773117952 00000100:00100000:1.0:1788639400.374367:0:24312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788639400.374371:0:24312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773117824:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788639400.374392:0:24312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:1.0:1788639400.374418:0:24312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262ddc0 00002000:00100000:1.0:1788639400.374431:0:24312:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ae243032000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788639400.374435:0:24312:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788639400.374437:0:24312:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788639400.374598:0:24312:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788639400.374637:0:24312:0:(import.c:65:import_set_state_nolock()) ffff9ae243030800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639400.375567:0:24312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875523773117824:12345-0@lo:8:kworker.0 Request processed in 1192us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639400.375576:0:24312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788639400.375593:0:24312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788639400.375605:0:24312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773117952:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788639400.375648:0:24312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788639400.375827:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae342fc2d80 x1875523773117824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788639420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639400.375849:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788639400.375857:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788639400.375874:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788639400.375880:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788639400.375882:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d188000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788639400.375939:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788639400.375956:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773117824:0@lo:8:kworker.0 00000004:00080000:0.0:1788639400.377049:0:23545:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788639400.377071:0:23545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23545:1875523773118592:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788639400.377113:0:23545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639400.377136:0:23545:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae241dc2f00 going to sleep for 11 seconds 00000004:00080000:0.0:1788639400.377765:0:23544:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788639400.377907:0:23544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 659172290250ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788639400.377913:0:23544:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788639400.377961:0:24311:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788639400.377968:0:24311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788639400.379634:0:24311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773118592 00000100:00100000:0.0:1788639400.379644:0:24311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773118592 00000100:00100000:2.0:1788639400.379997:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788639400.380008:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23545:x1875523773118592:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788639400.380754:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523773118336:12345-0@lo:400:kworker.0 Request processed in 6487us (6928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639400.380766:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788639400.380792:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639400.380798:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639400.380821:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639400.381129:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773118208:0@lo:400:kworker.0 00000100:00100000:0.0:1788639400.381179:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639400.381220:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788639400.381225:0:23535:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788639400.381257:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773117696:0@lo:400:kworker.0 00000100:00100000:0.0:1788639400.381283:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773117312:0@lo:400:kworker.0 00000100:00100000:0.0:1788639400.381311:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773118464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639400.381344:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639400.381383:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773118464 00000100:00100000:2.0:1788639400.381390:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773118464 00000100:00100000:2.0:1788639400.381422:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788639400.381434:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875523773118464:12345-0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788639400.381450:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae342fc0e00 x1875523773117568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639400.381461:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773117568:0@lo:400:kworker.0 00010000:00080000:0.0:1788639400.381470:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae342fc2300 x1875523773118336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639400.381489:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523773118336:0@lo:400:kworker.0 00000100:00100000:0.0:1788639400.381524:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773118208 00000100:00100000:0.0:1788639400.381528:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773118208 00000100:00100000:0.0:1788639400.381561:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773118080 00000100:00100000:0.0:1788639400.381564:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773118080 00000100:00100000:0.0:1788639400.381577:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788639400.381583:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773118208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639400.381637:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773118208:12345-0@lo:400:kworker.0 Request processed in 54us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639400.381642:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788639400.381654:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788639400.381659:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773118080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639400.382129:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773118080:12345-0@lo:400:kworker.0 Request processed in 468us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639400.382135:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788639400.382153:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788639400.382170:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae342fc1500 x1875523773118208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639400.382179:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773118208:0@lo:400:kworker.0 00010000:00080000:0.0:1788639400.382198:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae342fc3b80 x1875523773118080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639400.382205:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773118080:0@lo:400:kworker.0 00002000:00000024:2.0:1788639400.382532:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788639400.382582:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875523773118464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1152us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639400.382591:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788639400.382764:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae3748aad80 x1875523773118464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639400.382781:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773118464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639400.384505:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773117440 00000100:00100000:3.0:1788639400.384513:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773117440 00000100:00100000:3.0:1788639400.384635:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788639400.384643:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773117440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639400.385191:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773117440:12345-0@lo:400:kworker.0 Request processed in 548us (4370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639400.385198:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788639400.385244:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773117440:0@lo:400:kworker.0 00002000:00080000:2.0:1788639400.385525:0:24846:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788639400.385532:0:24846:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788639400.385583:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23545:x1875523773118592:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5577us (8468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639400.385602:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788639400.386300:0:23545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae3748ab100 x1875523773118592/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788639416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639400.386321:0:23545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23545:1875523773118592:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788639400.386339:0:23545:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788639400.386379:0:23545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23545:1875523773118720:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788639400.386791:0:23545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639400.386821:0:23545:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3431e9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639400.387496:0:24311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773118720 00000100:00100000:3.0:1788639400.387504:0:24311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773118720 00000100:00100000:3.0:1788639400.387772:0:24311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788639400.387781:0:24311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23545:x1875523773118720:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788639400.387807:0:24311:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788639400.387978:0:24311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23545:x1875523773118720:12345-0@lo:5:osp-pre-0-1.0 Request processed in 198us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639400.387986:0:24311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788639400.390313:0:23545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375c4aa00 x1875523773118720/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788639416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639400.390331:0:23545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23545:1875523773118720:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788639400.390345:0:23545:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788639400.390393:0:23545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432caa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23545:1875523773118848:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788639400.390440:0:23545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639400.390466:0:23545:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35872f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788639400.390487:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773118848 00000100:00100000:2.0:1788639400.390493:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773118848 00000100:00100000:2.0:1788639400.390530:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788639400.390538:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23545:x1875523773118848:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788639400.390573:0:24846:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1788639400.413493:0:24312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773117952:12345-0@lo:8:kworker.0 Request processed in 37880us (39570us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788639400.413506:0:24312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788639400.413812:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375f8d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788639400.413819:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788639400.413823:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773117952:0@lo:8:kworker.0 00000001:00080000:3.0:1788639400.430018:0:24307:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1788639400.430034:0:24307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788639400.432078:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23545:x1875523773118848:12345-0@lo:5:osp-pre-0-1.0 Request processed in 41532us (41628us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788639400.432089:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788639400.432188:0:23545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae2432caa00 x1875523773118848/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788639416 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639400.432201:0:23545:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788639400.432207:0:23545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432caa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23545:1875523773118848:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788639400.432222:0:23545:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788639400.432273:0:23545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23545:1875523773118976:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788639400.432309:0:23545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639400.432341:0:23545:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3431e9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788639400.432403:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773118976 00000100:00100000:1.0:1788639400.432410:0:22813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773118976 00000100:00100000:1.0:1788639400.432452:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788639400.432461:0:22813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23545:x1875523773118976:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788639400.432514:0:22813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23545:x1875523773118976:12345-0@lo:900:osp-pre-0-1.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639400.432521:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788639400.432581:0:23545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375c4aa00 x1875523773118976/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788639416 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639400.432591:0:23545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23545:1875523773118976:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788639400.820823:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639401.142077:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788639401.142095:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773119104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639401.142155:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639401.142194:0:23543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773119104 00000100:00100000:1.0:1788639401.142201:0:23543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773119104 00000100:00100000:1.0:1788639401.142241:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788639401.142249:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773119104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639401.142280:0:23543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788639401.142318:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773119104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639401.142324:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788639401.142364:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773119104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639401.150136:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773119232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639401.150198:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639401.150275:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773119232 00000100:00100000:2.0:1788639401.150282:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773119232 00000100:00100000:2.0:1788639401.150327:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788639401.150335:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773119232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639401.150363:0:22807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788639401.150411:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773119232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639401.150418:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788639401.150556:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773119232:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788639401.855437:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639402.868730:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639403.894797:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639404.918194:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788639405.306132:0:22838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1788639405.333557:0:25126:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788639405.333561:0:25126:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788639405.333568:0:25126:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788639405.333914:0:25126:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae243aea000 00000020:01000004:0.0:1788639405.333940:0:25126:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788639405.333954:0:25126:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788639405.333967:0:25126:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ae36cf08000) 00000020:00000080:0.0:1788639405.333984:0:25126:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788639405.389181:0:25126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788639405.390719:0:25126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788639405.391497:0:25126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788639405.392124:0:25126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788639405.392489:0:25126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788639405.392770:0:25126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788639405.393130:0:25126:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788639405.395757:0:25126:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788639405.395976:0:25126:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788639405.395990:0:25126:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788639405.396002:0:25126:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x25c454990262ddce 00000020:01000004:3.0:1788639405.396009:0:25126:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788639405.396031:0:25126:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788639405.396035:0:25126:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788639405.396042:0:25126:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788639405.396071:0:25126:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788639405.396074:0:25126:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788639405.407719:0:25126:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788639405.407760:0:25126:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.118@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788639405.407765:0:25126:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788639405.407767:0:25126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788639405.407768:0:25126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788639405.407770:0:25126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788639405.407771:0:25126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788639405.407773:0:25126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788639405.407774:0:25126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788639405.407776:0:25126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788639405.407777:0:25126:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788639405.407781:0:25126:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788639405.407783:0:25126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788639405.407785:0:25126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788639405.407786:0:25126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788639405.407787:0:25126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788639405.407788:0:25126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788639405.407789:0:25126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788639405.407790:0:25126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788639405.407791:0:25126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788639405.407792:0:25126:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788639405.407833:0:25126:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788639405.407851:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773119360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788639405.407939:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639405.407987:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae241dc26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639405.408102:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773119360 00000100:00100000:1.0:1788639405.408115:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773119360 00000100:00100000:1.0:1788639405.408170:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788639405.408178:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+21:25126:x1875523773119360:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788639405.408204:0:22795:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788639405.408207:0:22795:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788639405.408210:0:22795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788639405.408973:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+21:25126:x1875523773119360:12345-0@lo:253:mount.lustre.0 Request processed in 793us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639405.408983:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788639405.409113:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773119360:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788639405.409124:0:25126:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788639405.409127:0:25126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788639405.409129:0:25126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788639405.409130:0:25126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788639405.409140:0:25126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788639405.409141:0:25126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788639405.409142:0:25126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788639405.409144:0:25126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788639405.409145:0:25126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788639405.409147:0:25126:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788639405.409166:0:25126:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae243aea000 from lustre-OST0001 10000000:01000000:2.0:1788639405.409194:0:25126:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788639405.409197:0:25126:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788639405.409205:0:25126:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae37724b380 local copy 00010000:00010000:2.0:1788639405.409215:0:25126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639405.409303:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773119488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639405.409336:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639405.409480:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae241dc20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639405.409572:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773119488 00000100:00100000:1.0:1788639405.409578:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773119488 00000100:00100000:1.0:1788639405.409703:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788639405.409713:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+21:25126:x1875523773119488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639405.409792:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+21:25126:x1875523773119488:12345-0@lo:501:mount.lustre.0 Request processed in 81us (455us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788639405.409813:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788639405.410079:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773119488:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788639405.410096:0:25126:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788639405.410119:0:25126:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788639405.410126:0:25126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.410136:0:25126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9200/0x25c454990262dae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262daef expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639405.410168:0:25126:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae243aea000 10000000:01000000:0.0:1788639405.410173:0:25126:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788639405.410179:0:25126:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788639405.410181:0:25126:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788639405.410186:0:25126:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788639405.410188:0:25126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788639405.410211:0:25126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd400/0x25c454990262ddd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.410219:0:25126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd400/0x25c454990262ddd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.410229:0:25126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd400/0x25c454990262ddd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639405.410244:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773119616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788639405.410285:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639405.410413:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae369573d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639405.410674:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773119616 00000100:00100000:2.0:1788639405.410680:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773119616 00000100:00100000:0.0:1788639405.411201:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788639405.411211:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+21:25126:x1875523773119616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639405.411222:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639405.411235:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3748dc200/0x25c454990262dddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262ddd5 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.411258:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3748dc200/0x25c454990262dddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262ddd5 expref: 22 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.411268:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3748dc200/0x25c454990262dddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262ddd5 expref: 22 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.411276:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dc200, rc 0) 00000100:00100000:0.0:1788639405.411326:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+22:25126:x1875523773119616:12345-0@lo:101:mount.lustre.0 Request processed in 117us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639405.411332:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788639405.411406:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773119616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639405.411430:0:25126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd400/0x25c454990262ddd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dddc expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.411440:0:25126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd400/0x25c454990262ddd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262dddc expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788639405.412993:0:25126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788639405.413691:0:25126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788639405.416122:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788639405.416173:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788639405.416188:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788639405.416200:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788639405.416212:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788639405.416237:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788639405.416252:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788639405.416262:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788639405.416274:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788639405.416297:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788639405.416303:0:25126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788639405.416717:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773119744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639405.416779:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639405.417020:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae241dc20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639405.417103:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773119744 00000100:00100000:3.0:1788639405.417112:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773119744 00000100:00100000:3.0:1788639405.417163:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788639405.417174:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+22:25126:x1875523773119744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639405.417319:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+22:25126:x1875523773119744:12345-0@lo:501:mount.lustre.0 Request processed in 145us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639405.417327:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788639405.417558:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773119744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639405.417593:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773119872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639405.417657:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639405.417686:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae241dc20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639405.417794:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773119872 00000100:00100000:3.0:1788639405.417927:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773119872 00000100:00100000:3.0:1788639405.417960:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788639405.417966:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+22:25126:x1875523773119872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639405.419005:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+22:25126:x1875523773119872:12345-0@lo:503:mount.lustre.0 Request processed in 1034us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639405.419015:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788639405.419148:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773119872:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788639405.419747:0:25126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788639405.419966:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639405.420022:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639405.420126:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b1b6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788639405.420170:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773120000 00000100:00100000:0.0:1788639405.420176:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773120000 00000100:00100000:0.0:1788639405.420258:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788639405.420267:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+22:25126:x1875523773120000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639405.421102:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+22:25126:x1875523773120000:12345-0@lo:502:mount.lustre.0 Request processed in 832us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639405.421113:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788639405.421275:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639405.421574:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788639405.421605:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788639405.421649:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788639405.421666:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788639405.421680:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788639405.421695:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788639405.421709:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788639405.421724:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788639405.421752:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788639405.421782:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639405.422027:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639405.422111:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae241dc2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788639405.422188:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773120128 00000100:00100000:0.0:1788639405.422194:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773120128 00000100:00100000:0.0:1788639405.422235:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788639405.422250:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+22:25126:x1875523773120128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639405.422341:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+22:25126:x1875523773120128:12345-0@lo:502:mount.lustre.0 Request processed in 91us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639405.422464:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639405.422508:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788639405.422517:0:25126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788639405.423240:0:25130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788639405.423248:0:25130:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788639405.423255:0:25130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639405.423257:0:25130:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788639405.423263:0:25130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788639405.423277:0:25130:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ae36d184d40) 00000020:00000080:2.0:1788639405.423301:0:25130:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788639405.423308:0:25130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788639405.423496:0:25130:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae243aea000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788639405.423504:0:25130:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788639405.423510:0:25130:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x25c454990262ddea 00000100:00100000:0.0:1788639405.424466:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:2.0:1788639405.428798:0:25130:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788639405.429508:0:25130:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1788639405.431214:0:25130:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788639405.432957:0:25130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788639405.432968:0:25130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639405.432974:0:25130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639405.432976:0:25130:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788639405.432980:0:25130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639405.432984:0:25130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639405.432986:0:25130:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788639405.432989:0:25130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788639405.432991:0:25130:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788639405.432993:0:25130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639405.433001:0:25130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639405.433003:0:25130:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788639405.433006:0:25130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639405.433008:0:25130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639405.433010:0:25130:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788639405.433013:0:25130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788639405.433043:0:25130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639405.433047:0:25130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639405.433048:0:25130:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788639405.433052:0:25130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788639405.433677:0:25126:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788639405.433711:0:25126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788639405.433737:0:25126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd400/0x25c454990262ddd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dddc expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.433749:0:25126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd400/0x25c454990262ddd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262dddc expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639405.433757:0:25126:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae243aea000 from 1 10000000:01000000:3.0:1788639405.433760:0:25126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639405.433793:0:25126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.433815:0:25126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.433825:0:25126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639405.433862:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788639405.433934:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639405.433978:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242295f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639405.434249:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773120256 00000100:00100000:2.0:1788639405.434257:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773120256 00000100:00100000:2.0:1788639405.434317:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788639405.434328:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+22:25126:x1875523773120256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639405.434343:0:22795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639405.434562:0:22795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23600/0x25c454990262ddf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262ddf1 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.434587:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23600/0x25c454990262ddf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262ddf1 expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.434598:0:22795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23600/0x25c454990262ddf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262ddf1 expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.434607:0:22795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23600, rc 0) 00000100:00100000:2.0:1788639405.434688:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+23:25126:x1875523773120256:12345-0@lo:101:mount.lustre.0 Request processed in 362us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639405.434695:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788639405.434953:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639405.434970:0:25126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.434979:0:25126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639405.438486:0:25126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788639405.438794:0:25126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788639405.440575:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788639405.440654:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788639405.440673:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788639405.440689:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788639405.440705:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788639405.440721:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788639405.440736:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788639405.440751:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788639405.440767:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788639405.440783:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788639405.441003:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788639405.441037:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788639405.441043:0:25126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788639405.441138:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639405.441202:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639405.441304:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242295240 going to sleep for 11 seconds 00000100:00100000:1.0:1788639405.441953:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773120384 00000100:00100000:1.0:1788639405.441962:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773120384 00000100:00100000:1.0:1788639405.442006:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788639405.442015:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+23:25126:x1875523773120384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639405.442134:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+23:25126:x1875523773120384:12345-0@lo:501:mount.lustre.0 Request processed in 120us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639405.442142:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788639405.443705:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639405.443756:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639405.444169:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639405.444242:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242295240 going to sleep for 11 seconds 00000100:00100000:2.0:1788639405.444285:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773120512 00000100:00100000:2.0:1788639405.444292:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773120512 00000100:00100000:2.0:1788639405.444394:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788639405.444409:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+23:25126:x1875523773120512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639405.444963:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+23:25126:x1875523773120512:12345-0@lo:503:mount.lustre.0 Request processed in 553us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639405.444971:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788639405.445061:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120512:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788639405.445776:0:25126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788639405.445867:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639405.445981:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639405.446018:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242295f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639405.446063:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773120640 00000100:00100000:1.0:1788639405.446071:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773120640 00000100:00100000:1.0:1788639405.446147:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788639405.446156:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+23:25126:x1875523773120640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639405.446271:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+23:25126:x1875523773120640:12345-0@lo:502:mount.lustre.0 Request processed in 116us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639405.446278:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788639405.446343:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788639405.446530:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788639405.446556:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788639405.446572:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788639405.446585:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788639405.446598:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788639405.446610:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788639405.446652:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788639405.446666:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788639405.446679:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788639405.446692:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788639405.446706:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788639405.446728:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639405.446765:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639405.447210:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242295f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639405.447245:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773120768 00000100:00100000:2.0:1788639405.447251:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773120768 00000100:00100000:2.0:1788639405.447280:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788639405.447287:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+23:25126:x1875523773120768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639405.447555:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+23:25126:x1875523773120768:12345-0@lo:502:mount.lustre.0 Request processed in 267us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639405.447563:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788639405.447766:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788639405.447977:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788639405.447994:0:25126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788639405.448726:0:25134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639405.448737:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639405.448739:0:25134:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788639405.448745:0:25134:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae243aea000 00000020:00000080:3.0:1788639405.448748:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788639405.448754:0:25134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639405.448757:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639405.448758:0:25134:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788639405.448760:0:25134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639405.448762:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639405.448763:0:25134:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788639405.448766:0:25134:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae243aea000 00000020:00000080:3.0:1788639405.448768:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788639405.449299:0:25134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639405.449305:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639405.449307:0:25134:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788639405.449310:0:25134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639405.449313:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639405.449314:0:25134:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788639405.449317:0:25134:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae243aea000 00000020:00000080:3.0:1788639405.449319:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788639405.449337:0:25134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639405.449340:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639405.449341:0:25134:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788639405.449343:0:25134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639405.449345:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639405.450969:0:25134:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788639405.450982:0:25134:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae243aea000 00000020:00000080:3.0:1788639405.450985:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788639405.451046:0:25134:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639405.451050:0:25134:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639405.451052:0:25134:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788639405.451055:0:25134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788639405.452164:0:25126:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788639405.452206:0:25126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788639405.452385:0:25126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.452398:0:25126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639405.452477:0:25126:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788639405.452480:0:25126:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae243aea000 10000000:01000000:0.0:1788639405.452483:0:25126:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae243aea000 10000000:01000000:0.0:1788639405.452488:0:25126:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788639405.452493:0:25126:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae243aea000 from 1 10000000:01000000:0.0:1788639405.452496:0:25126:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788639405.452534:0:25126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd600/0x25c454990262ddff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.452543:0:25126:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd600/0x25c454990262ddff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.452553:0:25126:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd600/0x25c454990262ddff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639405.452575:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788639405.452658:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639405.452707:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343e8ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639405.453487:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773120896 00000100:00100000:2.0:1788639405.453495:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773120896 00000100:00100000:2.0:1788639405.453549:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788639405.453557:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+23:25126:x1875523773120896:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639405.453571:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639405.453585:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23e00/0x25c454990262de06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262ddff expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.453609:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23e00/0x25c454990262de06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262ddff expref: 24 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.453648:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23e00/0x25c454990262de06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262ddff expref: 24 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.453656:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23e00, rc 0) 00000100:00100000:2.0:1788639405.453700:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773120896:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639405.453713:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788639405.454552:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773120896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639405.454571:0:25126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd600/0x25c454990262ddff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262de06 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.454581:0:25126:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd600/0x25c454990262ddff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262de06 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788639405.459256:0:25126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788639405.459729:0:25126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788639405.460661:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788639405.460695:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788639405.460710:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788639405.460722:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788639405.460734:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788639405.460746:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788639405.460757:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788639405.460769:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788639405.460781:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788639405.460791:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788639405.461999:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788639405.462037:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788639405.462052:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788639405.462066:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788639405.462080:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788639405.462092:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788639405.462105:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788639405.462118:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788639405.462131:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788639405.462144:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788639405.462158:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788639405.462170:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788639405.462182:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788639405.462197:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788639405.462227:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788639405.462243:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788639405.462267:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788639405.462280:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788639405.462293:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788639405.462305:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788639405.462317:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788639405.462329:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788639405.462341:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788639405.462763:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788639405.462780:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788639405.462794:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788639405.462946:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788639405.462965:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788639405.462980:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788639405.462995:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788639405.463025:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788639405.463043:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788639405.463064:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788639405.463083:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788639405.463103:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788639405.463125:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788639405.463142:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788639405.463159:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788639405.463334:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788639405.463704:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788639405.463731:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788639405.463737:0:25126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788639405.463981:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773121024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639405.464057:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639405.464151:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d325900 going to sleep for 11 seconds 00000100:00100000:2.0:1788639405.464195:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773121024 00000100:00100000:2.0:1788639405.464203:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773121024 00000100:00100000:2.0:1788639405.464247:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788639405.464259:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773121024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639405.464572:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773121024:12345-0@lo:501:mount.lustre.0 Request processed in 315us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639405.464580:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788639405.464723:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773121024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639405.464757:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773121152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639405.464798:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639405.464836:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d325900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639405.464838:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773121152 00000100:00100000:0.0:1788639405.464842:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773121152 00000100:00100000:0.0:1788639405.464877:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788639405.464884:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773121152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639405.464985:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773121152:12345-0@lo:503:mount.lustre.0 Request processed in 101us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639405.464992:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788639405.465059:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773121152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788639405.465412:0:25126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788639405.465479:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773121280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639405.465514:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639405.465531:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344326240 going to sleep for 11 seconds 00000100:00100000:2.0:1788639405.465776:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773121280 00000100:00100000:2.0:1788639405.465782:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773121280 00000100:00100000:2.0:1788639405.468560:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788639405.468580:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773121280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639405.468769:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773121280:12345-0@lo:502:mount.lustre.0 Request processed in 195us (3253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639405.468777:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788639405.469143:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773121280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639405.469526:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788639405.469561:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788639405.469577:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788639405.469592:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788639405.470252:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788639405.470278:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788639405.470291:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788639405.470304:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788639405.470316:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788639405.470328:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788639405.470341:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788639405.470970:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788639405.470991:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788639405.471006:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788639405.471019:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788639405.471031:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788639405.471045:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788639405.471058:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788639405.471071:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788639405.471083:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788639405.471113:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788639405.472985:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788639405.473027:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788639405.473043:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788639405.473057:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788639405.473071:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788639405.473084:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788639405.473096:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788639405.473109:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788639405.473122:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788639405.473134:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788639405.473147:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788639405.473160:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788639405.473173:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788639405.473185:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788639405.473197:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788639405.473228:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788639405.473244:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788639405.473259:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788639405.473273:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788639405.473287:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788639405.473301:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788639405.473315:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788639405.473328:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788639405.473340:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788639405.474527:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788639405.474552:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788639405.474564:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788639405.474625:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773121408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639405.474694:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639405.474735:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d325900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639405.475149:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773121408 00000100:00100000:0.0:1788639405.475156:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773121408 00000100:00100000:0.0:1788639405.475235:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788639405.475244:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773121408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639405.475363:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773121408:12345-0@lo:502:mount.lustre.0 Request processed in 119us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639405.475370:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788639405.475453:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773121408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639405.475641:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788639405.475663:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788639405.475684:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773121536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639405.475716:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639405.481262:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773121536 00000100:00100000:1.0:1788639405.481275:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773121536 00000100:00100000:2.0:1788639405.481980:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243338540 going to sleep for 11 seconds 00000100:00100000:3.0:1788639405.482228:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788639405.482241:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773121536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639405.482408:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773121536:12345-0@lo:502:mount.lustre.0 Request processed in 170us (6690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639405.482535:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788639405.482667:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773121536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639405.482749:0:25126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788639405.482763:0:25126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788639405.484127:0:25139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788639405.484142:0:25139:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ae3691ccd40) 00000020:00000080:3.0:1788639405.484165:0:25139:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788639405.484253:0:25139:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae243aea000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788639405.484257:0:25139:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae243aea000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788639405.484260:0:25139:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae243aea000 3 00010000:00080000:3.0:1788639405.484291:0:25139:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae346556000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.118@tcp at head 00010000:00010000:1.0:1788639405.492243:0:25139:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788639405.492762:0:25139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788639405.493524:0:25139:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788639405.493536:0:25139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x25c454990262de14 00000100:00080000:1.0:1788639405.493546:0:25139:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788639405.493552:0:25139:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae346556000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639405.493584:0:25139:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae243b14700 x1875523773121664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788639405.493612:0:25139:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788639405.493677:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639405.493681:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639405.493683:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639405.493686:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639405.493708:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639405.493710:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788639405.493713:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae375f8d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788639405.493716:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:1.0:1788639405.493720:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788639405.493724:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ae375f8d800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639405.493736:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae243b16a00 x1875523773122304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788639405.493775:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773122176:0@lo:400:kworker.0 00000100:00100000:0.0:1788639405.494532:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773121792:0@lo:400:kworker.0 00000100:00100000:3.0:1788639405.494592:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773121664:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788639405.496448:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639405.496491:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773122432:0@lo:400:kworker.0 00000100:00100000:0.0:1788639405.496522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639405.496572:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773121792 00000100:00100000:0.0:1788639405.496580:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773121792 00000100:00100000:0.0:1788639405.496644:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788639405.496655:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773121792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639405.496709:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773121792:12345-0@lo:400:kworker.0 Request processed in 56us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639405.496716:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788639405.496737:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773122432 00000100:00100000:0.0:1788639405.496740:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773122432 00000100:00100000:0.0:1788639405.496763:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788639405.496768:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773122432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639405.496794:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773122432:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639405.496814:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788639405.496851:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773121792:0@lo:400:kworker.0 00010000:00080000:0.0:1788639405.496865:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae380295c00 x1875523773122432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639405.496874:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773122432:0@lo:400:kworker.0 00000100:00100000:3.0:1788639405.498431:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639405.498484:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773122304:0@lo:8:kworker.0 00000100:00100000:0.0:1788639405.498491:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773121664 00000100:00100000:0.0:1788639405.498500:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773121664 00000100:00100000:3.0:1788639405.498519:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639405.498545:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788639405.498553:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875523773121664:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788639405.498561:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773122304 00000100:00100000:3.0:1788639405.498567:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773122304 00010000:00080000:0.0:1788639405.498577:0:22803:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000100:00100000:3.0:1788639405.498592:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788639405.498600:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875523773122304:12345-0@lo:8:kworker.0 00000020:00000080:0.0:1788639405.498611:0:22803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x25c454990262de1b 00000004:00100000:0.0:1788639405.498764:0:22803:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788639405.498792:0:22803:0:(import.c:65:import_set_state_nolock()) ffff9ae241e99800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639405.498795:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875523773122304:12345-0@lo:8:kworker.0 Request processed in 193us (273us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788639405.498888:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875523773121664:12345-0@lo:38:llog_process_th.0 Request processed in 279us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639405.498895:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788639405.498959:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243b14700 x1875523773121664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639405.498976:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788639405.498984:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788639405.498992:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788639405.498997:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788639405.498999:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae346556000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788639405.499005:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773121664:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788639405.499017:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788639405.499020:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375f8d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788639405.499024:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788639405.499026:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773122304:0@lo:8:kworker.0 00000100:00100000:3.0:1788639405.499071:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:2.0:1788639405.500002:0:25139:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788639405.500017:0:25139:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ae36d1819c0) 00000020:00000080:2.0:1788639405.500037:0:25139:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788639405.500109:0:25139:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae243aea000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788639405.500113:0:25139:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae243aea000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788639405.500115:0:25139:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae243aea000 3 00010000:00080000:2.0:1788639405.500139:0:25139:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae243aaa000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.118@tcp at head 00010000:00010000:2.0:1788639405.501756:0:25139:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788639405.501969:0:25139:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788639405.502017:0:25139:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788639405.502029:0:25139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x25c454990262de29 00000100:00080000:2.0:1788639405.502038:0:25139:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788639405.502044:0:25139:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ae243aaa000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639405.502077:0:25139:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2432cb100 x1875523773122816/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639405.502111:0:25139:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788639405.502121:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639405.502149:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875523773122816:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788639405.502168:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773121920:0@lo:400:kworker.0 00000100:00100000:2.0:1788639405.502188:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639405.502197:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639405.502216:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773122560:0@lo:400:kworker.0 00000100:00100000:1.0:1788639405.502235:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639405.502264:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788639405.502270:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773122048:0@lo:400:kworker.0 00000100:00100000:1.0:1788639405.502295:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639405.502314:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773122688:0@lo:400:kworker.0 00000100:00100000:1.0:1788639405.502337:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639405.502367:0:24312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773122176 00000100:00100000:1.0:1788639405.502373:0:24312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773122176 00000100:00100000:1.0:1788639405.502418:0:24312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788639405.502427:0:24312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773122176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639405.502473:0:24312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773122176:12345-0@lo:400:kworker.0 Request processed in 47us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639405.502481:0:24312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788639405.502500:0:23543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773122048 00000100:00100000:1.0:1788639405.502503:0:23543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773122048 00000100:00100000:1.0:1788639405.502523:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788639405.502529:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773122048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639405.502563:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773122048:12345-0@lo:400:kworker.0 Request processed in 33us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639405.502569:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788639405.502601:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773122048:0@lo:400:kworker.0 00000100:00100000:1.0:1788639405.502658:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773122816 00000100:00100000:1.0:1788639405.502661:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773122816 00000100:00100000:1.0:1788639405.502675:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773121920 00000100:00100000:1.0:1788639405.502682:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773121920 00000100:00100000:1.0:1788639405.502698:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773122560 00000100:00100000:1.0:1788639405.502701:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773122560 00000100:00100000:1.0:1788639405.502714:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773122688 00000100:00100000:1.0:1788639405.502716:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773122688 00000100:00100000:1.0:1788639405.502729:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788639405.502733:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773121920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639405.502766:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773121920:12345-0@lo:400:kworker.0 Request processed in 32us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639405.502772:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788639405.502782:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788639405.502787:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773122560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639405.502811:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773122560:12345-0@lo:400:kworker.0 Request processed in 25us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639405.502817:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788639405.502827:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788639405.502832:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773122688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639405.502857:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773122688:12345-0@lo:400:kworker.0 Request processed in 25us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639405.502862:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788639405.502873:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788639405.502876:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875523773122816:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788639405.502896:0:22804:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000100:00080000:0.0:1788639405.502911:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788639405.502926:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639405.502929:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788639405.502937:0:22804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x25c454990262de30 00000004:00100000:1.0:1788639405.502951:0:22804:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788639405.502978:0:22804:0:(import.c:65:import_set_state_nolock()) ffff9ae36f25b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639405.503031:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875523773122816:12345-0@lo:38:llog_process_th.0 Request processed in 153us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639405.503037:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788639405.503062:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae380295180 x1875523773122688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639405.503072:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773122688:0@lo:400:kworker.0 00010000:00080000:1.0:1788639405.503080:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243b14000 x1875523773121920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639405.503087:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773121920:0@lo:400:kworker.0 00010000:00080000:1.0:1788639405.503095:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae380295f80 x1875523773122560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639405.503101:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773122560:0@lo:400:kworker.0 00010000:00080000:1.0:1788639405.503130:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae2432cb100 x1875523773122816/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639405.503138:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639405.503144:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788639405.503150:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788639405.503154:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788639405.503157:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae243aaa000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788639405.503161:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875523773122816:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788639405.503180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639405.503184:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639405.503187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639405.503194:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:1.0:1788639405.503223:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243b17480 x1875523773122176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639405.503234:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773122176:0@lo:400:kworker.0 00000040:00080000:2.0:1788639405.503735:0:25139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788639405.504121:0:25126:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788639405.504155:0:25126:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788639405.504174:0:25126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd600/0x25c454990262ddff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262de06 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639405.504185:0:25126:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd600/0x25c454990262ddff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262de06 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788639405.504231:0:25126:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788639405.504233:0:25126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788639405.504235:0:25126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639405.504236:0:25126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639405.504237:0:25126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639405.504239:0:25126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639405.504240:0:25126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788639405.504242:0:25126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639405.504243:0:25126:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788639405.504247:0:25126:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788639405.504249:0:25126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788639405.504250:0:25126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788639405.504252:0:25126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639405.504253:0:25126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639405.504254:0:25126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639405.504255:0:25126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639405.504256:0:25126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788639405.504257:0:25126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639405.504258:0:25126:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788639405.504277:0:25126:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788639405.504291:0:25126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773122944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788639405.505477:0:25126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639405.505519:0:25126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259780 going to sleep for 11 seconds 00000100:00100000:1.0:1788639405.505542:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773122944 00000100:00100000:1.0:1788639405.505549:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773122944 00000100:00100000:1.0:1788639405.505597:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788639405.505606:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773122944:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788639405.505656:0:22794:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788639405.505672:0:22794:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788639405.507040:0:22794:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788639405.507093:0:22794:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788639405.507378:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+24:25126:x1875523773122944:12345-0@lo:253:mount.lustre.0 Request processed in 1769us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639405.507389:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788639405.507540:0:25126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a452a6f1-70bc-4918-a445-81111879f6e1:25126:1875523773122944:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788639405.507555:0:25126:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788639405.507558:0:25126:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788639405.507559:0:25126:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788639405.507561:0:25126:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639405.507562:0:25126:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639405.507563:0:25126:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639405.507565:0:25126:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639405.507566:0:25126:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788639405.507568:0:25126:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639405.507569:0:25126:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788639405.507585:0:25126:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788639405.507999:0:22818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788639405.508005:0:22818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788639405.508025:0:22818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.508051:0:22818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2421f9c00/0x25c454990262ddab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dda4 expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.508059:0:22818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2421f9e00/0x25c454990262ddb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262ddb2 expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.508066:0:22818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.508102:0:22818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2421f9e00/0x25c454990262ddb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262ddb2 expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.508117:0:22818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2421f9e00/0x25c454990262ddb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262ddb2 expref: 23 pid: 22795 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639405.508132:0:22818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773123072:0@lo:104: 00000100:00100000:3.0:1788639405.508173:0:22818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788639405.508214:0:22818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2421f9c00/0x25c454990262ddab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262dda4 expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.508222:0:22818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2421f9c00/0x25c454990262ddab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262dda4 expref: 23 pid: 22796 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639405.508230:0:22818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773123200:0@lo:104: 00000100:00100000:3.0:1788639405.508252:0:22818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639405.508270:0:22818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242295600 going to sleep for 11 seconds 00000100:00100000:3.0:1788639405.508293:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773123072 00000100:00100000:3.0:1788639405.508298:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773123072 00000100:00100000:3.0:1788639405.508326:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773123200 00000100:00100000:3.0:1788639405.508334:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773123200 00000100:00100000:3.0:1788639405.508352:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788639405.508360:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a452a6f1-70bc-4918-a445-81111879f6e1+4:22818:x1875523773123072:12345-0@lo:104: 00010000:00010000:3.0:1788639405.508375:0:22785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.508415:0:22785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788639405.508434:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a452a6f1-70bc-4918-a445-81111879f6e1+4:22818:x1875523773123072:12345-0@lo:104: Request processed in 74us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639405.508440:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788639405.508455:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788639405.508460:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a452a6f1-70bc-4918-a445-81111879f6e1+3:22818:x1875523773123200:12345-0@lo:104: 00010000:00010000:3.0:1788639405.508467:0:22785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.508503:0:22785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788639405.508509:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a452a6f1-70bc-4918-a445-81111879f6e1+3:22818:x1875523773123200:12345-0@lo:104: Request processed in 49us (256us total) trans 0 rc 0/0 00010000:00010000:2.0:1788639405.508513:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788639405.508514:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788639405.508519:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.508526:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd800 already unused, calling callback (ffffffffc131ec20) 00010000:00010000:3.0:1788639405.508527:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1788639405.508530:0:22790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.508538:0:22790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639405.508545:0:22790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639405.508551:0:22818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773123072:0@lo:104: 10000000:01000000:2.0:1788639405.508551:0:22790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1788639405.508559:0:22818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22818:1875523773123200:0@lo:104: 00010000:00010000:3.0:1788639405.508573:0:22818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.508578:0:22790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.508583:0:22790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639405.508607:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639405.508632:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773123328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639405.508633:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3748dd800/0x25c454990262ddb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262ddb9 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639405.508655:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639405.508657:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639405.508657:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639405.508659:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639405.508701:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773123328 00000100:00100000:3.0:1788639405.508705:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773123328 00010000:00010000:3.0:1788639405.508721:0:22787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2421f9e00/0x25c454990262ddb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262ddb2 expref: 24 pid: 22795 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639405.508741:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788639405.508746:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+24:3641:x1875523773123328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639405.508756:0:22787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639405.508760:0:22787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2421f9e00/0x25c454990262ddb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262ddb2 expref: 24 pid: 22795 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.508770:0:22787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2421f9e00/0x25c454990262ddb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262ddb2 expref: 24 pid: 22795 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.508782:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2421f9e00/0x25c454990262ddb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262ddb2 expref: 24 pid: 22795 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639405.508793:0:22787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639405.508831:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a452a6f1-70bc-4918-a445-81111879f6e1+23:3641:x1875523773123328:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639405.508837:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788639405.508859:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773123328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639405.509802:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639405.509805:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639405.509808:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639405.509883:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.509893:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e200 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639405.509896:0:22791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.509906:0:22791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639405.509914:0:22791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639405.509934:0:22791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639405.509979:0:22791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.509985:0:22791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639405.510002:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510009:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262dda4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262ddab expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510024:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639405.510025:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639405.510027:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639405.510038:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773123456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639405.510082:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639405.510133:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773123456 00000100:00100000:0.0:1788639405.510138:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773123456 00010000:00010000:0.0:1788639405.510158:0:24337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2421f9c00/0x25c454990262ddab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dda4 expref: 23 pid: 22796 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639405.510184:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788639405.510191:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a452a6f1-70bc-4918-a445-81111879f6e1+23:3642:x1875523773123456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639405.510212:0:24337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639405.510217:0:24337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2421f9c00/0x25c454990262ddab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dda4 expref: 23 pid: 22796 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510227:0:24337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2421f9c00/0x25c454990262ddab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262dda4 expref: 23 pid: 22796 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510238:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2421f9c00/0x25c454990262ddab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262dda4 expref: 23 pid: 22796 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510257:0:24337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510266:0:24337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788639405.510279:0:24337:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009072010s 00010000:00010000:0.0:1788639405.510284:0:24337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510291:0:24337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510297:0:24337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510303:0:24337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510308:0:24337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9fc00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639405.510312:0:24337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510319:0:24337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510331:0:24337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510341:0:24337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639405.510377:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a452a6f1-70bc-4918-a445-81111879f6e1+22:3642:x1875523773123456:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639405.510384:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788639405.510409:0:22818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510416:0:22818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639405.510438:0:22818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f9fc00/0x25c454990262de37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639405.510468:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3748ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773123456:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1788639405.511745:0:25126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788639405.514097:0:25126:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788639405.514107:0:25126:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788639405.514152:0:25126:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788639405.514200:0:25126:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788639405.514219:0:25126:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788639405.514240:0:25126:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788639405.517412:0:25126:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788639405.521975:0:25126:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788639405.750336:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773123584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639405.750413:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639405.751085:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773123584 00000100:00100000:3.0:1788639405.751096:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773123584 00000100:00100000:3.0:1788639405.751151:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788639405.751162:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773123584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788639405.751209:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788639405.751265:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773123584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639405.751273:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788639405.751686:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae2438cf480 x1875523773123584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639405.751708:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773123584:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788639405.941017:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639406.260887:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773123712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639406.260990:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639406.261051:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773123712 00000100:00100000:0.0:1788639406.261059:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773123712 00000100:00100000:0.0:1788639406.261118:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788639406.261122:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773123840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639406.261130:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773123712:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639406.261161:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788639406.261169:0:22807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788639406.261220:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773123840 00000100:00100000:0.0:1788639406.261221:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773123712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639406.261225:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773123840 00000100:00100000:3.0:1788639406.261245:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773123712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639406.261246:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788639406.264168:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788639406.264193:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773123840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639406.264244:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788639406.266670:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773123840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2480us (5499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639406.266699:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788639406.267467:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773123840:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788639406.476921:0:25193:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788639406.477129:0:25193:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788639406.712699:0:22799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788639406.712705:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae342c41800 from 14 10000000:01000000:3.0:1788639406.712710:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788639406.712755:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f600/0x25c454990262de3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639406.712767:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f600/0x25c454990262de3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639406.712777:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f600/0x25c454990262de3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639406.712801:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773123968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639406.712865:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639406.712921:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242295d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639406.712964:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773123968 00000100:00100000:1.0:1788639406.712974:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773123968 00000100:00100000:1.0:1788639406.713029:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788639406.713039:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+22:22799:x1875523773123968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639406.713052:0:22795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639406.713066:0:22795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f9c00/0x25c454990262de45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262de3e expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639406.713090:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f9c00/0x25c454990262de45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262de3e expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639406.713101:0:22795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f9c00/0x25c454990262de45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262de3e expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639406.713110:0:22795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9c00, rc 0) 00000100:00100000:1.0:1788639406.713154:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+23:22799:x1875523773123968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639406.713162:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788639406.713186:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773123968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639406.713202:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f600/0x25c454990262de3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262de45 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639406.713211:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f600/0x25c454990262de3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262de45 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639406.713259:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773124096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788639406.713294:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639406.713316:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242295d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639406.713423:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773124096 00000100:00100000:1.0:1788639406.713428:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773124096 00000100:00100000:1.0:1788639406.713456:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788639406.713463:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+23:22799:x1875523773124096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788639406.713478:0:22794:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788639406.713495:0:22794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788639406.713498:0:22794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788639406.724920:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773124096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788639406.725006:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788639406.725017:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f600/0x25c454990262de3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262de45 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639406.725027:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f600/0x25c454990262de3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262de45 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639406.725038:0:22799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788639406.725041:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae36cf54000 from 14 10000000:01000000:2.0:1788639406.725044:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788639406.725078:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f23000/0x25c454990262de4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639406.725085:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f23000/0x25c454990262de4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639406.725094:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f23000/0x25c454990262de4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639406.725113:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773124224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639406.725149:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639406.725195:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae241dc2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639406.725217:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773124224 00000100:00100000:2.0:1788639406.725223:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773124224 00000100:00100000:2.0:1788639406.725267:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788639406.725276:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+24:22799:x1875523773124224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639406.725290:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639406.725303:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f22200/0x25c454990262de53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262de4c expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639406.725325:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f22200/0x25c454990262de53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262de4c expref: 25 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639406.725335:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f22200/0x25c454990262de53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262de4c expref: 25 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639406.725343:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22200, rc 0) 00000100:00100000:2.0:1788639406.725374:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+25:22799:x1875523773124224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639406.725380:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788639406.725429:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773124224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639406.725443:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f23000/0x25c454990262de4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262de53 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639406.725451:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f23000/0x25c454990262de4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262de53 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639406.725493:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773124352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788639406.725519:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639406.725538:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae241dc2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639406.725549:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773124352 00000100:00100000:2.0:1788639406.725552:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773124352 00000100:00100000:2.0:1788639406.725569:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788639406.725575:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+25:22799:x1875523773124352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788639406.725587:0:22796:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788639406.725601:0:22796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788639406.725604:0:22796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788639406.725694:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+25:22799:x1875523773124352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639406.725700:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788639406.725725:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773124352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788639406.726155:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788639406.726162:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f23000/0x25c454990262de4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262de53 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639406.726170:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f23000/0x25c454990262de4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262de53 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639406.726302:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+24:22799:x1875523773124096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 12839us (13006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639406.726319:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:3.0:1788639406.964810:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639407.350596:0:23559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788639407.990806:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639408.564970:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639388/real 1788639388] req@ffff9ae375c49c00 x1875523773111296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639408 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639408.565008:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae375c49c00 x1875523773111296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639408 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639408.565019:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639388/real 1788639388] req@ffff9ae375c48380 x1875523773111424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639408 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639408.565032:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae375c48380 x1875523773111424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639408 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788639408.565064:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae34b10d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639408.565133:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788639408.565138:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773111296:0@lo:8:kworker.0 00000100:00080000:1.0:1788639408.565146:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae37f752800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788639408.567760:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773124480:0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.567861:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788639408.567870:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639408.567877:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788639408.567881:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae34b10d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639408.567890:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 647 00000100:00080000:2.0:1788639408.567897:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788639408.567920:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae34b10d800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639408.567951:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2432cb480 x1875523773124736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639408.567984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639408.567988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788639408.567989:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae37f752800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639408.567993:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 647 00000100:00080000:2.0:1788639408.567996:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788639408.567999:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae37f752800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639408.568015:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2432caa00 x1875523773124864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639408.568047:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639408.568050:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788639408.568052:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae375f8d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639408.568056:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ae375f8d800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639408.568067:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae342fc0000 x1875523773125376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639408.568237:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773125120:0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.568335:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773125248:0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.568384:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639408.568413:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523773125888:0@lo:400:kworker.0 00000100:00100000:2.0:1788639408.568437:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639408.568481:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639408.568492:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773125760:0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.568536:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773124480 00000100:00100000:2.0:1788639408.568549:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639408.568550:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773124480 00000100:00100000:2.0:1788639408.568603:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773124992:0@lo:400:kworker.0 00000100:00100000:2.0:1788639408.568655:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639408.568673:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523773125632:0@lo:400:kworker.0 00000100:00100000:2.0:1788639408.568702:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639408.568724:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788639408.568737:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+24:3642:x1875523773124480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.568806:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+24:3642:x1875523773124480:12345-0@lo:400:kworker.0 Request processed in 71us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639408.568815:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788639408.568887:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788639408.568917:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773124608:0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.568950:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773125248 00000100:00100000:2.0:1788639408.568957:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639408.568958:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773125248 00000100:00100000:2.0:1788639408.568992:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773125504:0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.569016:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788639408.569023:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639408.569028:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773125248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639408.569041:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773126016:0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.569088:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773125248:12345-0@lo:400:kworker.0 Request processed in 63us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639408.569095:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788639408.569116:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773125120 00000100:00100000:0.0:1788639408.569121:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773125120 00000100:00100000:0.0:1788639408.569158:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773124608 00000100:00100000:0.0:1788639408.569162:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773124608 00000100:00100000:0.0:1788639408.569177:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788639408.569183:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773125120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.569220:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773125120:12345-0@lo:400:kworker.0 Request processed in 38us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639408.569224:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788639408.569245:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788639408.569250:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773124608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.569272:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773124608:12345-0@lo:400:kworker.0 Request processed in 23us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639408.569276:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788639408.569289:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773125888 00000100:00100000:0.0:1788639408.569292:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773125888 00000100:00100000:0.0:1788639408.569308:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773125760 00000100:00100000:0.0:1788639408.569310:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773125760 00000100:00100000:0.0:1788639408.569319:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773124992 00000100:00100000:0.0:1788639408.569321:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773124992 00000100:00100000:0.0:1788639408.569329:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773125632 00000100:00100000:0.0:1788639408.569330:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773125632 00000100:00100000:0.0:1788639408.569340:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773125504 00000100:00100000:0.0:1788639408.569342:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773125504 00000100:00100000:0.0:1788639408.569352:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788639408.569356:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523773125888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.569391:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523773125888:12345-0@lo:400:kworker.0 Request processed in 33us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639408.569401:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788639408.569411:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639408.569430:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773126016 00000100:00100000:0.0:1788639408.569435:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773126016 00000100:00100000:2.0:1788639408.569465:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773124608:0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.569473:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788639408.569483:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773125760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639408.569518:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788639408.569528:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773125760:12345-0@lo:400:kworker.0 Request processed in 46us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639408.569537:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773124992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.569550:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788639408.569573:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788639408.569582:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523773125632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639408.569661:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773124992:12345-0@lo:400:kworker.0 Request processed in 90us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639408.569670:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788639408.569680:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523773125632:12345-0@lo:400:kworker.0 Request processed in 99us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639408.569690:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788639408.569703:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639408.569717:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788639408.569726:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773126016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.569756:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773126016:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639408.569762:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788639408.569783:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788639408.569787:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639408.569790:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639408.569830:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773125120:0@lo:400:kworker.0 00010000:00080000:0.0:1788639408.569848:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae342fc2300 x1875523773125760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639408.569860:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773125760:0@lo:400:kworker.0 00010000:00080000:0.0:1788639408.569910:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae342fc0700 x1875523773125248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639408.569919:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773125248:0@lo:400:kworker.0 00010000:00080000:0.0:1788639408.569945:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae342fc0e00 x1875523773125888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639408.569954:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523773125888:0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.569970:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773124480:0@lo:400:kworker.0 00000100:00100000:2.0:1788639408.570055:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773125504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639408.570112:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773125504:12345-0@lo:400:kworker.0 Request processed in 400us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639408.570121:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788639408.570171:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788639408.570183:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773111424:0@lo:8:kworker.0 00010000:00080000:2.0:1788639408.570188:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae342fc3b80 x1875523773125504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639408.570204:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773125504:0@lo:400:kworker.0 00010000:00080000:2.0:1788639408.570229:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae342fc1180 x1875523773126016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639408.570239:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773126016:0@lo:400:kworker.0 00010000:00080000:2.0:1788639408.570265:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c9180 x1875523773124992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639408.570275:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773124736:0@lo:8:kworker.0 00000100:00100000:2.0:1788639408.570302:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773124992:0@lo:400:kworker.0 00010000:00080000:2.0:1788639408.570340:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae342fc1500 x1875523773125632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639408.570350:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639408.570366:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523773125632:0@lo:400:kworker.0 00000100:00100000:0.0:1788639408.570407:0:24312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773124736 00000100:00100000:0.0:1788639408.570414:0:24312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773124736 00000100:00100000:1.0:1788639408.570421:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773124864:0@lo:8:kworker.0 00000100:00100000:0.0:1788639408.570448:0:24312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788639408.570458:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639408.570458:0:24312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773124736:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788639408.570487:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773124864 00010000:00080000:0.0:1788639408.570493:0:24312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000100:00100000:2.0:1788639408.570497:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773124864 00000100:00100000:1.0:1788639408.570505:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773125376:0@lo:8:kworker.0 00000020:00000080:0.0:1788639408.570549:0:24312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262de5a 00000100:00100000:1.0:1788639408.570558:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639408.570566:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00002000:00100000:0.0:1788639408.570573:0:24312:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ae241e9d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1788639408.570576:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875523773124864:12345-0@lo:8:kworker.0 00002000:00080000:0.0:1788639408.570588:0:24312:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:1.0:1788639408.570602:0:24313:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00002000:00100000:0.0:1788639408.570603:0:24312:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1788639408.570659:0:24846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000100:00100000:1.0:1788639408.570661:0:24313:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000020:00000080:2.0:1788639408.570698:0:24846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262de61 00002000:00100000:2.0:1788639408.570712:0:24846:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ae243aaf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788639408.570717:0:24846:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788639408.570721:0:24846:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788639408.570756:0:24312:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788639408.570794:0:24312:0:(import.c:65:import_set_state_nolock()) ffff9ae241e9f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639408.570846:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773125376 00000100:00100000:1.0:1788639408.570853:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773125376 00000100:00100000:0.0:1788639408.570866:0:24312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875523773124736:12345-0@lo:8:kworker.0 Request processed in 408us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639408.570877:0:24312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788639408.570919:0:24312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788639408.570926:0:24312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773125376:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788639408.570948:0:24312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:0.0:1788639408.570973:0:24312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262de68 00002000:00100000:0.0:1788639408.570982:0:24312:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ae241e9a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788639408.570986:0:24312:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788639408.571010:0:24312:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:1.0:1788639408.571060:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cb480 x1875523773124736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788639433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788639408.571067:0:24312:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00002000:00080000:2.0:1788639408.571069:0:24846:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1788639408.571073:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639408.571084:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788639408.571093:0:24312:0:(import.c:65:import_set_state_nolock()) ffff9ae241e9b000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788639408.571096:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788639408.571105:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788639408.571108:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae34b10d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788639408.571110:0:24846:0:(import.c:65:import_set_state_nolock()) ffff9ae243aad800 : changing import state from RECOVER to FULL 00000004:00080000:1.0:1788639408.571126:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788639408.571137:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773124736:0@lo:8:kworker.0 00010000:00080000:1.0:1788639408.571160:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae342fc0000 x1875523773125376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788639433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639408.571164:0:24312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875523773125376:12345-0@lo:8:kworker.0 Request processed in 236us (610us total) trans 0 rc 0/0 00000100:00080000:1.0:1788639408.571180:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00100000:0.0:1788639408.571186:0:24312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788639408.571187:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1875523773124864:12345-0@lo:8:kworker.0 Request processed in 604us (723us total) trans 0 rc 0/0 00000100:00080000:1.0:1788639408.571190:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788639408.571203:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788639408.571210:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375f8d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788639408.571216:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:0.0:1788639408.571226:0:22826:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788639408.571230:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788639408.571236:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773125376:0@lo:8:kworker.0 00000004:00080000:2.0:1788639408.571256:0:23546:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:1.0:1788639408.571268:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432caa00 x1875523773124864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788639433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639408.571278:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639408.571283:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788639408.571291:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788639408.571295:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788639408.571298:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae37f752800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788639408.571329:0:22826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 667365711882ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788639408.571330:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000004:00080000:2.0:1788639408.571334:0:23546:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 667365717014ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788639408.571341:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773124864:0@lo:8:kworker.0 00080000:00080000:0.0:1788639408.571341:0:22826:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00080000:00080000:2.0:1788639408.571347:0:23546:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1788639408.571408:0:22829:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000004:00080000:1.0:1788639408.571416:0:22827:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1788639408.571434:0:22829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22829:1875523773126400:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788639408.571440:0:22827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380297100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22827:1875523773126528:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788639408.571475:0:22829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788639408.571502:0:23547:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788639408.571504:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24202fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639408.571519:0:23547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23547:1875523773126784:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788639408.571729:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773126400 00000100:00100000:0.0:1788639408.571735:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773126400 00000100:00100000:2.0:1788639408.571760:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773126144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639408.571788:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639408.571800:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22829:x1875523773126400:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788639408.571833:0:23547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639408.571835:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639408.571863:0:23547:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae369573c00 going to sleep for 11 seconds 00000004:00080000:3.0:1788639408.571875:0:22828:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788639408.571890:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773126272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639408.571895:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773126784 00000100:00100000:1.0:1788639408.571920:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773126784 00000004:00080000:3.0:1788639408.571953:0:22828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 667366335649ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788639408.571963:0:22828:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788639408.571971:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639408.572021:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773126144 00000100:00100000:2.0:1788639408.572028:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773126144 00000100:00100000:1.0:1788639408.572030:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788639408.572049:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23547:x1875523773126784:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788639408.572079:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773126272 00000100:00100000:0.0:1788639408.572085:0:22827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639408.572087:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773126272 00000100:00100000:1.0:1788639408.572107:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788639408.572126:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788639408.572126:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae369573cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639408.572127:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773126656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639408.572148:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523773126144:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788639408.572150:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639408.572158:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639408.572172:0:24312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773126528 00000100:00100000:1.0:1788639408.572182:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788639408.572185:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788639408.572185:0:24312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773126528 00000100:00100000:0.0:1788639408.572224:0:24312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788639408.572233:0:24312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:22827:x1875523773126528:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788639408.572259:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773126144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639408.572269:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788639408.572295:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773126656 00000100:00100000:2.0:1788639408.572300:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773126656 00010000:00080000:1.0:1788639408.572336:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae380296d80 x1875523773126144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639408.572355:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773126144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639408.572448:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788639408.572459:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773126272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639408.572476:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788639408.572522:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773126272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639408.572528:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788639408.572543:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788639408.572556:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1875523773126656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639408.572566:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788639408.572609:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1875523773126656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639408.572647:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788639408.572687:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243b14e00 x1875523773126272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639408.572708:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773126272:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788639408.572821:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae380297800 x1875523773126656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639408.572837:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773126656:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1788639408.573980:0:22782:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788639408.574489:0:23535:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788639408.577746:0:24312:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788639408.577766:0:24312:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788639408.577775:0:24312:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00080000:2.0:1788639408.582178:0:24313:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788639408.582207:0:24313:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1788639408.582215:0:24313:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00000004:00080000:1.0:1788639408.583570:0:22782:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788639408.590233:0:25311:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788639408.590244:0:25311:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788639408.590345:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23547:x1875523773126784:12345-0@lo:7:osp-pre-1-1.0 Request processed in 18301us (18520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639408.590356:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788639408.590418:0:23547:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae380295500 x1875523773126784/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788639424 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639408.590433:0:23547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23547:1875523773126784:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788639408.590446:0:23547:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788639408.590489:0:23547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23547:1875523773126912:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788639408.590520:0:23547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639408.590552:0:23547:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae369573c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639408.590568:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773126912 00000100:00100000:1.0:1788639408.590574:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773126912 00000100:00100000:1.0:1788639408.590607:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788639408.590633:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23547:x1875523773126912:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788639408.590655:0:25311:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788639408.590684:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23547:x1875523773126912:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639408.590690:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788639408.590712:0:23547:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae380295500 x1875523773126912/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788639424 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639408.590720:0:23547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23547:1875523773126912:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788639408.590727:0:23547:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788639408.590747:0:23547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23547:1875523773127040:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788639408.590770:0:23547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639408.590780:0:23547:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae369573c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639408.590798:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773127040 00000100:00100000:1.0:1788639408.590801:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773127040 00000100:00100000:1.0:1788639408.590819:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788639408.590824:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23547:x1875523773127040:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788639408.590847:0:25311:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1788639408.598322:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.598334:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857916e1/0x25c454990262de6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.598349:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.598354:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.598360:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000857916e1/0x25c454990262de6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.598376:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000857916e1/0x25c454990262de6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.598386:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857916e1/0x25c454990262de6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.598394:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000857916e1/0x25c454990262de6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.598417:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639408.598447:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.598463:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000857916e1/0x25c454990262de6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.598477:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dc400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.598484:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000857916e1/0x25c454990262de6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.598497:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000857916e1/0x25c454990262de6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.598530:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000857916e1/0x25c454990262de6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.598540:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000857916e1/0x25c454990262de6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.598665:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.598670:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.598672:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.599977:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.599987:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048e42592/0x25c454990262de76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.600002:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.600013:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.600020:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048e42592/0x25c454990262de76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.600034:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048e42592/0x25c454990262de76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.600043:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048e42592/0x25c454990262de76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.600050:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048e42592/0x25c454990262de76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.600071:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639408.600449:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639408.600457:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048e42592/0x25c454990262de76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.600466:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.600471:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048e42592/0x25c454990262de76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.600481:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048e42592/0x25c454990262de76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.600500:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048e42592/0x25c454990262de76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.600508:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048e42592/0x25c454990262de76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.600527:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.600529:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.600531:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788639408.602080:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.602089:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262de7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.602110:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.602113:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.602119:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262de7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.602132:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262de7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.602141:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262de7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.602149:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262de7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.602170:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788639408.603048:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.603057:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073281cca/0x25c454990262de84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.603068:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.603071:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.603075:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073281cca/0x25c454990262de84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.603084:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073281cca/0x25c454990262de84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.603106:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073281cca/0x25c454990262de84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.603113:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073281cca/0x25c454990262de84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.603131:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788639408.603355:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639408.603363:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262de7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.603371:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8a00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.603376:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262de7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.603384:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262de7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.603400:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262de7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.603420:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262de7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.603442:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.603446:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073281cca/0x25c454990262de84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.603452:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.603456:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073281cca/0x25c454990262de84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.603463:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073281cca/0x25c454990262de84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.603474:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073281cca/0x25c454990262de84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.603482:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073281cca/0x25c454990262de84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.603496:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.603500:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.603504:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.604132:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.604140:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262de8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.604155:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.604159:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.604164:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262de8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.604175:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262de8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.604185:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262de8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.604192:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262de8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.604208:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.604217:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.604220:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262de8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.604227:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dce00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.604230:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262de8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.604238:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262de8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.604262:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262de8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.604270:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262de8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.604286:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.604288:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.604289:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.605779:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.605789:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262de92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.605802:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.605806:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.605813:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262de92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.605826:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262de92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.605836:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262de92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.605926:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262de92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.605957:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.605969:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.605974:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262de92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.605981:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dde00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.605985:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262de92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.605993:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262de92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.606008:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262de92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.606015:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262de92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.606032:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.606034:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.606035:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788639408.607153:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.607161:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002167afc4/0x25c454990262de99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.607173:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.607177:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.607181:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002167afc4/0x25c454990262de99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.607194:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002167afc4/0x25c454990262de99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.607203:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002167afc4/0x25c454990262de99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.607210:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002167afc4/0x25c454990262de99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.607241:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.608129:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.608137:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002167afc4/0x25c454990262de99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.608147:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.608161:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002167afc4/0x25c454990262de99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.608171:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002167afc4/0x25c454990262de99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.608188:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002167afc4/0x25c454990262de99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.608196:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002167afc4/0x25c454990262de99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.608217:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.608218:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.608220:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.609003:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788639408.609997:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.610008:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262dea0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.610022:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.610027:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.610032:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262dea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.610049:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262dea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.610058:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262dea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.610066:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262dea0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.610082:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.610443:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.610450:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262dea0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.610457:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9e00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.610462:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262dea0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.610470:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262dea0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.610486:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262dea0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.610500:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262dea0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.610518:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.610520:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.610522:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.610571:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.610576:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262dea7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.610585:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.610588:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.610592:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262dea7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.610603:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262dea7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.610611:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262dea7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.610647:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262dea7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.610663:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639408.611720:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639408.611730:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262dea7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.611740:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dcc00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.611754:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262dea7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.611765:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262dea7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.611783:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262dea7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.611790:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262dea7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.611823:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.611825:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.611830:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.612044:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.612057:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262deae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.612068:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.612072:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.612077:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262deae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.612089:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262deae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.612098:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262deae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.612107:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262deae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.612124:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.612134:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.612138:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262deae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.612145:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dda00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.612148:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262deae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.612155:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262deae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.612172:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262deae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.612179:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262deae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.612194:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.612196:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.612197:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639408.612952:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.612961:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262deb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.612972:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.612975:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.612980:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262deb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.612992:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262deb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.613001:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262deb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.613008:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262deb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.613024:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639408.613033:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639408.613037:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262deb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.613044:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639408.613048:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262deb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.613064:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262deb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.613077:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262deb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.613085:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262deb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.613100:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.613101:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.613103:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639408.614286:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.614296:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009efd547d/0x25c454990262debc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.614308:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.614312:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.614318:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009efd547d/0x25c454990262debc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.614332:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009efd547d/0x25c454990262debc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.614341:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009efd547d/0x25c454990262debc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.614702:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009efd547d/0x25c454990262debc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.614719:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788639408.614916:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.614922:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094e33051/0x25c454990262dec3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.614931:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.614934:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.614938:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094e33051/0x25c454990262dec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.614948:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094e33051/0x25c454990262dec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.614969:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094e33051/0x25c454990262dec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.614977:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094e33051/0x25c454990262dec3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.614994:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788639408.615003:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639408.615007:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009efd547d/0x25c454990262debc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615021:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22a00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639408.615025:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009efd547d/0x25c454990262debc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615034:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009efd547d/0x25c454990262debc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615049:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009efd547d/0x25c454990262debc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615057:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009efd547d/0x25c454990262debc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615073:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639408.615077:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094e33051/0x25c454990262dec3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615083:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639408.615086:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094e33051/0x25c454990262dec3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615093:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094e33051/0x25c454990262dec3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615103:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094e33051/0x25c454990262dec3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615116:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094e33051/0x25c454990262dec3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615127:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.615129:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.615130:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639408.615677:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.615684:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc503b63/0x25c454990262deca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615694:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.615697:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.615702:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc503b63/0x25c454990262deca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615712:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc503b63/0x25c454990262deca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615720:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc503b63/0x25c454990262deca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615729:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc503b63/0x25c454990262deca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615743:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639408.615751:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639408.615761:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc503b63/0x25c454990262deca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615767:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639408.615771:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc503b63/0x25c454990262deca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615778:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc503b63/0x25c454990262deca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615790:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc503b63/0x25c454990262deca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615798:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc503b63/0x25c454990262deca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615812:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.615814:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.615816:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639408.615868:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.615873:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262ded1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615880:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.615883:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.615887:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262ded1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615918:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262ded1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615926:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262ded1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615933:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262ded1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615955:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639408.615964:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639408.615967:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262ded1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615974:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ae00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639408.615977:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262ded1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615985:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262ded1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.615995:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262ded1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.616002:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262ded1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.616022:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.616024:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.616026:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639408.619313:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.619325:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc2a761b/0x25c454990262ded8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.619340:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.619344:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.619350:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc2a761b/0x25c454990262ded8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.619363:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc2a761b/0x25c454990262ded8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.619373:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc2a761b/0x25c454990262ded8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.619381:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc2a761b/0x25c454990262ded8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.619880:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.620266:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.620273:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc2a761b/0x25c454990262ded8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.620282:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.620287:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc2a761b/0x25c454990262ded8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.620297:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc2a761b/0x25c454990262ded8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.620313:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc2a761b/0x25c454990262ded8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.620320:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc2a761b/0x25c454990262ded8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.620351:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.620353:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.620355:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639408.621285:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.621293:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dedf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.621317:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.621322:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.621328:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dedf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.621341:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dedf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.621351:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dedf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.621359:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dedf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.621376:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639408.621385:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639408.621390:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dedf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.621398:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639408.621414:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dedf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.621424:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dedf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.621449:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dedf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.621457:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dedf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.621473:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.621474:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.621476:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639408.622088:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.622100:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0b274d/0x25c454990262dee6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.622109:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.622113:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.622118:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d0b274d/0x25c454990262dee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.622129:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d0b274d/0x25c454990262dee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.622137:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0b274d/0x25c454990262dee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.622144:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d0b274d/0x25c454990262dee6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.622162:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639408.622537:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639408.622543:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d0b274d/0x25c454990262dee6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.622551:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639408.622555:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0b274d/0x25c454990262dee6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.622563:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0b274d/0x25c454990262dee6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.622576:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d0b274d/0x25c454990262dee6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.622584:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d0b274d/0x25c454990262dee6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.622612:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.622633:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.622635:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639408.622881:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.622887:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262deed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.622897:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.622915:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.622920:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262deed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.622932:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262deed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.622947:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262deed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.622956:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262deed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.622972:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788639408.623302:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.623308:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262def4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.623316:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.623319:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.623323:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262def4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.623332:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262def4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.623340:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262def4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.623347:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262def4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.623362:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788639408.623676:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639408.623682:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262deed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.623689:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.623693:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262deed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.623701:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262deed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.623713:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262deed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.623720:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262deed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.623735:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.623739:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262def4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.623746:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.623756:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262def4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.623764:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262def4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.623774:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262def4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.623780:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262def4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.623794:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.623795:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.623797:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.624252:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.624259:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262defb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.624267:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.624270:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.624275:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262defb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.624284:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262defb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.624292:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262defb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.624306:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262defb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.624321:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639408.624653:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639408.624658:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262defb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.624676:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dde00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639408.624680:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262defb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.624688:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262defb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.624700:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262defb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.624707:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e31cab/0x25c454990262defb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.624723:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.624725:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.624726:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.624809:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.625186:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639408.625224:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.625232:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373deb2d/0x25c454990262df02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.625242:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.625245:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.625250:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373deb2d/0x25c454990262df02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.625261:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000373deb2d/0x25c454990262df02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.625269:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373deb2d/0x25c454990262df02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.625276:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000373deb2d/0x25c454990262df02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.625308:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639408.625334:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639408.625341:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000373deb2d/0x25c454990262df02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.625350:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ee00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.625354:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000373deb2d/0x25c454990262df02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.625363:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000373deb2d/0x25c454990262df02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.625377:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000373deb2d/0x25c454990262df02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.625392:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373deb2d/0x25c454990262df02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.625409:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.625411:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.625413:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639408.625610:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.625817:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c76a2053/0x25c454990262df09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.625826:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.625829:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.625834:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c76a2053/0x25c454990262df09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788639408.626549:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.626557:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071dd2b61/0x25c454990262df10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.626567:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.626571:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.626576:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071dd2b61/0x25c454990262df10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.626586:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071dd2b61/0x25c454990262df10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.626603:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071dd2b61/0x25c454990262df10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.626611:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071dd2b61/0x25c454990262df10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.626657:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.627070:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.627077:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071dd2b61/0x25c454990262df10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.627086:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.627090:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071dd2b61/0x25c454990262df10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.627099:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071dd2b61/0x25c454990262df10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.627115:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071dd2b61/0x25c454990262df10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.627123:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071dd2b61/0x25c454990262df10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.627141:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.627143:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.627144:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.627204:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c76a2053/0x25c454990262df09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.627213:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c76a2053/0x25c454990262df09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.627221:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c76a2053/0x25c454990262df09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.627247:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639408.628483:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639408.628491:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c76a2053/0x25c454990262df09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.628502:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9fc00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.628506:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c76a2053/0x25c454990262df09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.628516:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c76a2053/0x25c454990262df09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.628532:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c76a2053/0x25c454990262df09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.628540:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c76a2053/0x25c454990262df09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.628557:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.628559:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.628560:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639408.630384:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.630396:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262df17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.630412:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.630425:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.630433:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262df17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.630447:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262df17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.630466:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262df17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.630475:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262df17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.630493:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639408.631643:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639408.631653:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262df17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.631666:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.631672:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262df17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.631683:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262df17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.631705:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262df17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.631714:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262df17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.631732:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.631734:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.631736:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788639408.631809:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.631815:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcbc5836/0x25c454990262df1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.631826:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.631830:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.631836:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcbc5836/0x25c454990262df1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.631860:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcbc5836/0x25c454990262df1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.631870:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcbc5836/0x25c454990262df1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.631878:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcbc5836/0x25c454990262df1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.631913:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788639408.632918:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.632934:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262df25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.632947:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.632951:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.632957:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262df25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.632967:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262df25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.632976:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262df25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.632983:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262df25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.633003:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788639408.633339:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788639408.633347:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcbc5836/0x25c454990262df1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633355:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9e00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.633359:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcbc5836/0x25c454990262df1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633368:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcbc5836/0x25c454990262df1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633382:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcbc5836/0x25c454990262df1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633390:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcbc5836/0x25c454990262df1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633436:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639408.633440:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262df25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633801:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dda00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.633805:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262df25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633813:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262df25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633825:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262df25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633831:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000832c71d5/0x25c454990262df25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633858:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.633860:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.633862:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788639408.633890:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.633896:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002167afc4/0x25c454990262df2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633915:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.633926:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.633931:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002167afc4/0x25c454990262df2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633941:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002167afc4/0x25c454990262df2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633951:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002167afc4/0x25c454990262df2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633958:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002167afc4/0x25c454990262df2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.633977:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788639408.634703:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.634711:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073281cca/0x25c454990262df33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.634721:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.634724:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.634728:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073281cca/0x25c454990262df33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.634738:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073281cca/0x25c454990262df33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.634746:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073281cca/0x25c454990262df33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.634760:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073281cca/0x25c454990262df33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.634775:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788639408.634786:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788639408.634790:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002167afc4/0x25c454990262df2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.634796:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.634800:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002167afc4/0x25c454990262df2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.634808:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002167afc4/0x25c454990262df2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.634820:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002167afc4/0x25c454990262df2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.634828:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002167afc4/0x25c454990262df2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.634973:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.634978:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073281cca/0x25c454990262df33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.634986:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.634989:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073281cca/0x25c454990262df33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.634996:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073281cca/0x25c454990262df33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.635015:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073281cca/0x25c454990262df33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.635022:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073281cca/0x25c454990262df33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.635057:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.635059:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.635061:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788639408.638464:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.638488:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fc2fbef/0x25c454990262df3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.638506:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.638512:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.638519:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fc2fbef/0x25c454990262df3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.638534:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fc2fbef/0x25c454990262df3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.638545:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fc2fbef/0x25c454990262df3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.638554:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fc2fbef/0x25c454990262df3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.638578:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639408.638590:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639408.638596:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fc2fbef/0x25c454990262df3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.638605:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8a00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.638610:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fc2fbef/0x25c454990262df3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.638655:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fc2fbef/0x25c454990262df3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.638679:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fc2fbef/0x25c454990262df3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.638687:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fc2fbef/0x25c454990262df3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.638710:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.638713:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.638715:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.638934:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.638938:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.638941:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.639146:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.639155:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.639164:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262df41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788639408.639176:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.639176:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.639184:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.639187:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.639191:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262df41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639205:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.639211:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.639211:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262df41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639221:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.639226:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262df41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639235:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.639238:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262df41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639253:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639271:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.639295:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788639408.639302:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788639408.639312:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788639408.639317:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262df41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639323:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dce00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.639327:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262df41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639335:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262df41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639351:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262df41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639358:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7cb60b6/0x25c454990262df41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639373:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639408.639376:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639383:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639408.639385:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.639387:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639417:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639427:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639434:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.639447:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.639449:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.639451:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639408.639961:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.639968:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262df4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.639978:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.639981:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.639986:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262df4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.639995:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262df4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.640004:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262df4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.640017:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262df4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.640033:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639408.640043:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.640047:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262df4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.640054:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.640058:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262df4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.640066:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262df4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.640090:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262df4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.640097:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262df4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.640109:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.640110:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.640112:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.640201:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.640208:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262df56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.640217:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.640221:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.640225:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262df56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.640234:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262df56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.640243:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262df56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.640249:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262df56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.640275:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788639408.642380:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.642392:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642406:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.642417:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.642423:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642436:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642446:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642455:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642474:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788639408.642485:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639408.642490:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262df56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642498:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.642503:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262df56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642512:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262df56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642525:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262df56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642544:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262df56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642560:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.642564:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642570:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.642573:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642581:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642592:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642599:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.642610:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.642612:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.642634:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.643040:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.645079:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.645092:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8146fc/0x25c454990262df64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.645117:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.645121:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.645127:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df8146fc/0x25c454990262df64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.645141:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df8146fc/0x25c454990262df64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.645152:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8146fc/0x25c454990262df64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.645160:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df8146fc/0x25c454990262df64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.645178:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639408.646199:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.646208:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df8146fc/0x25c454990262df64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.646219:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dca00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.646225:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8146fc/0x25c454990262df64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.646235:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8146fc/0x25c454990262df64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.646257:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df8146fc/0x25c454990262df64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.646266:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df8146fc/0x25c454990262df64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.646289:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.646291:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.646293:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788639408.647736:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.647746:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.647761:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.647765:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.647772:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.647785:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.647796:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.647815:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.647845:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639408.651639:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.651653:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.651666:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.651671:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.651694:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.651714:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.651721:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000103856a6/0x25c454990262df6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.651739:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.651741:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.651743:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788639408.651809:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.651817:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000902d05c/0x25c454990262df72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.651828:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.651833:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.651851:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000902d05c/0x25c454990262df72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.651864:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000902d05c/0x25c454990262df72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.651873:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000902d05c/0x25c454990262df72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.651880:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000902d05c/0x25c454990262df72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.651909:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639408.652336:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.652342:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000902d05c/0x25c454990262df72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.652350:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750faa00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.652354:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000902d05c/0x25c454990262df72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.652362:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000902d05c/0x25c454990262df72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.652374:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000902d05c/0x25c454990262df72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.652392:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000902d05c/0x25c454990262df72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.652674:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.652676:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.652678:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788639408.652782:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.652789:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013d414da/0x25c454990262df79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.652806:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.652810:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.652815:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013d414da/0x25c454990262df79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.652826:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013d414da/0x25c454990262df79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.652834:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013d414da/0x25c454990262df79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.652842:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013d414da/0x25c454990262df79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.652927:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788639408.653113:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.653265:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.653270:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013d414da/0x25c454990262df79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653278:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.653282:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013d414da/0x25c454990262df79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653290:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013d414da/0x25c454990262df79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653302:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013d414da/0x25c454990262df79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653309:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013d414da/0x25c454990262df79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653322:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.653324:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.653326:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.653353:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000165c5f68/0x25c454990262df80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.653363:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.653366:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.653370:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000165c5f68/0x25c454990262df80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.653381:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000165c5f68/0x25c454990262df80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.653400:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000165c5f68/0x25c454990262df80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.653406:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000165c5f68/0x25c454990262df80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.653595:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788639408.653760:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.653766:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d37e9bf/0x25c454990262df87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.653774:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.653777:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.653780:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d37e9bf/0x25c454990262df87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.653789:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d37e9bf/0x25c454990262df87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.653797:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d37e9bf/0x25c454990262df87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.653804:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d37e9bf/0x25c454990262df87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639408.653820:0:25127:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00010000:00010000:3.0:1788639408.653893:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788639408.653907:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000165c5f68/0x25c454990262df80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653915:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.653919:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000165c5f68/0x25c454990262df80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653927:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000165c5f68/0x25c454990262df80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653940:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000165c5f68/0x25c454990262df80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653947:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000165c5f68/0x25c454990262df80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653962:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.653965:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d37e9bf/0x25c454990262df87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653971:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbc00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.653974:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d37e9bf/0x25c454990262df87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.653980:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d37e9bf/0x25c454990262df87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.654002:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d37e9bf/0x25c454990262df87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.654010:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.654012:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.654014:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788639408.654037:0:25127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788639408.654046:0:25127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788639408.654238:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:23547:x1875523773127040:12345-0@lo:5:osp-pre-1-1.0 Request processed in 63410us (63463us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788639408.654247:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788639408.654290:0:23547:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788639408.654297:0:23547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23547:1875523773127040:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788639408.654312:0:23547:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788639408.654356:0:23547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23547:1875523773127168:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788639408.654389:0:23547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639408.654421:0:23547:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae369573c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639408.654722:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773127168 00000100:00100000:0.0:1788639408.654729:0:22814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773127168 00000100:00100000:0.0:1788639408.654772:0:22814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788639408.654781:0:22814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23547:x1875523773127168:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788639408.654831:0:22814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23547:x1875523773127168:12345-0@lo:900:osp-pre-1-1.0 Request processed in 51us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639408.654837:0:22814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788639408.654877:0:23547:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2438ced80 x1875523773127168/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788639424 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639408.654888:0:23547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23547:1875523773127168:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1788639408.654997:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788639408.655005:0:24312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d37e9bf/0x25c454990262df87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788639408.655104:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.655110:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.655120:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.655124:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.655130:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.655141:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.655149:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.655156:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.655236:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.655242:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.655251:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.655255:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.655264:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.655285:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df8e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.655294:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.655296:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.655297:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.655353:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788639408.655358:0:24313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cda7b15/0x25c454990262df8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788639408.655374:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.655379:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050de7626/0x25c454990262df95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.655387:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.655390:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.655394:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050de7626/0x25c454990262df95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.655402:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050de7626/0x25c454990262df95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.655410:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050de7626/0x25c454990262df95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.655417:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050de7626/0x25c454990262df95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.655439:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788639408.655733:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.655739:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000358b2b78/0x25c454990262df9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.655755:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.655758:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.655762:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000358b2b78/0x25c454990262df9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.655771:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000358b2b78/0x25c454990262df9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.655780:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000358b2b78/0x25c454990262df9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.655787:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000358b2b78/0x25c454990262df9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.655851:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.655857:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050de7626/0x25c454990262df95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.655864:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fba00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.655867:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050de7626/0x25c454990262df95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.655876:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050de7626/0x25c454990262df95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.655887:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050de7626/0x25c454990262df95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.655894:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050de7626/0x25c454990262df95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.655919:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.655921:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.655922:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.655934:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.657491:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.657512:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262dfa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.657526:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.657530:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.657535:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262dfa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.657546:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262dfa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.657556:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262dfa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.657564:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262dfa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.657581:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.657591:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.657596:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262dfa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.657602:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.657606:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262dfa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.658038:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262dfa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.658063:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262dfa3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.658666:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003709f119/0x25c454990262dfa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.658689:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.658690:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.658693:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.658744:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639408.659360:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639408.659368:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000358b2b78/0x25c454990262df9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.659377:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.659381:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000358b2b78/0x25c454990262df9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.659391:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000358b2b78/0x25c454990262df9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.659418:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000358b2b78/0x25c454990262df9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.659426:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000358b2b78/0x25c454990262df9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.659560:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.659562:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.659564:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788639408.660578:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.660588:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee18b68/0x25c454990262dfaa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.660601:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.660605:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.660612:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ee18b68/0x25c454990262dfaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.660649:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ee18b68/0x25c454990262dfaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.660659:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee18b68/0x25c454990262dfaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.660668:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ee18b68/0x25c454990262dfaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.660701:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788639408.661090:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.661098:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dfb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.661112:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.661115:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.661119:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dfb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.661129:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dfb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.661137:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dfb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.661144:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dfb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.661168:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788639408.661170:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.661174:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262dfb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661182:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.661185:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.661189:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262dfb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661197:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262dfb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661205:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262dfb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661212:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262dfb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661226:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788639408.661234:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788639408.661238:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ee18b68/0x25c454990262dfaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661245:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639408.661255:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee18b68/0x25c454990262dfaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661264:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee18b68/0x25c454990262dfaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661278:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ee18b68/0x25c454990262dfaa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661287:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ee18b68/0x25c454990262dfaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661303:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788639408.661306:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dfb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661312:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.661312:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639408.661316:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dfb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.661317:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262dfb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661324:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dfb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.661324:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fae00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.661328:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262dfb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661333:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dfb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.661336:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262dfb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661341:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f9bd544/0x25c454990262dfb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.661346:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262dfb8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.661354:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262dfb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661360:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.661362:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.661363:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.661376:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.661378:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.661380:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639408.661731:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1788639408.661731:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.661738:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262dfc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661738:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1300030/0x25c454990262dfbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.661748:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.661748:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.661751:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.661751:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.661756:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262dfc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661756:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1300030/0x25c454990262dfbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.661767:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262dfc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661767:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1300030/0x25c454990262dfbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.661776:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262dfc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661776:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1300030/0x25c454990262dfbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.661785:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262dfc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661785:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1300030/0x25c454990262dfbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.661844:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788639408.663339:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639408.663350:0:24312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262dfcd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.663380:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=667s v=(0 0) 00010000:00010000:1.0:1788639408.663384:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639408.663390:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262dfcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.663416:0:24312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262dfcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.663427:0:24312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262dfcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639408.663434:0:24312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262dfcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.664767:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788639408.665985:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788639408.665996:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1300030/0x25c454990262dfbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666009:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.666014:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1300030/0x25c454990262dfbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666024:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1300030/0x25c454990262dfbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666043:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1300030/0x25c454990262dfbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666051:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1300030/0x25c454990262dfbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666074:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639408.666077:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262dfc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788639408.666080:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.666084:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ae00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639408.666087:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af387e94/0x25c454990262dfd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666093:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262dfc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.666098:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.666100:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262dfc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.666106:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.666110:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262dfc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.666112:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af387e94/0x25c454990262dfd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666118:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262dfc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.666124:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af387e94/0x25c454990262dfd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666128:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.666131:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262dfcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.666133:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af387e94/0x25c454990262dfd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666137:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.666140:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262dfcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.666142:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af387e94/0x25c454990262dfd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666148:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262dfcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.666152:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.666154:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262dfcd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666160:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.666167:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af387e94/0x25c454990262dfd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666173:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78bc00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.666175:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af387e94/0x25c454990262dfd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666182:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af387e94/0x25c454990262dfd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666190:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af387e94/0x25c454990262dfd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666197:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af387e94/0x25c454990262dfd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.666208:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.666210:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.666212:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.666231:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.672043:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.672057:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df8146fc/0x25c454990262dfdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.672075:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.672080:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.672086:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df8146fc/0x25c454990262dfdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.672120:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df8146fc/0x25c454990262dfdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.672130:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df8146fc/0x25c454990262dfdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.672138:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df8146fc/0x25c454990262dfdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.672158:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.672169:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.672175:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df8146fc/0x25c454990262dfdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.672183:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dca00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.672187:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df8146fc/0x25c454990262dfdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.672196:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df8146fc/0x25c454990262dfdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.672210:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df8146fc/0x25c454990262dfdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.672218:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df8146fc/0x25c454990262dfdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.672242:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.672244:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.672246:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.673422:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.673432:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262dfe2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.673445:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.673449:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.673455:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262dfe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.673466:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262dfe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.673477:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262dfe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.673485:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262dfe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.673503:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.673512:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.673517:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262dfe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.673534:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dce00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.673538:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262dfe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.673547:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262dfe2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.673561:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262dfe2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.673568:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262dfe2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.673581:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.673583:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.673585:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639408.674508:0:24312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788639408.674517:0:24312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262dfcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.674520:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.674561:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788639408.674735:0:24312:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:2.0:1788639408.674842:0:24312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22827:x1875523773126528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 102605us (102756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639408.674854:0:24312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788639408.675060:0:22827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380297100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22827:1875523773126528:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788639408.675074:0:22827:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:1.0:1788639408.675110:0:22827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380297100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22827:1875523773127296:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788639408.675143:0:22827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639408.675171:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae350ca5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788639408.677653:0:24311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773127296 00000100:00100000:3.0:1788639408.677665:0:24311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773127296 00000100:00100000:3.0:1788639408.677710:0:24311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788639408.677720:0:24311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22827:x1875523773127296:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788639408.677759:0:24311:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00010000:2.0:1788639408.682684:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.682698:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c9067e3/0x25c454990262dfe9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.682713:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.682718:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.682724:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c9067e3/0x25c454990262dfe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.682752:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c9067e3/0x25c454990262dfe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.682762:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c9067e3/0x25c454990262dfe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.682770:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c9067e3/0x25c454990262dfe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.682794:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788639408.685987:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639408.686001:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027e6f44d/0x25c454990262dff0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.686018:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=667s v=(0 0) 00010000:00010000:2.0:1788639408.686023:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639408.686030:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027e6f44d/0x25c454990262dff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.686044:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027e6f44d/0x25c454990262dff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.686055:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027e6f44d/0x25c454990262dff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.686077:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027e6f44d/0x25c454990262dff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.686094:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788639408.686106:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639408.686112:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c9067e3/0x25c454990262dfe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.686293:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.686299:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027e6f44d/0x25c454990262dff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.686308:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ac00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.686312:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027e6f44d/0x25c454990262dff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.686321:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027e6f44d/0x25c454990262dff0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.686337:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027e6f44d/0x25c454990262dff0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.686344:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027e6f44d/0x25c454990262dff0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.686360:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.686362:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.686363:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.686825:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639408.686830:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c9067e3/0x25c454990262dfe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.686839:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c9067e3/0x25c454990262dfe9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.686852:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c9067e3/0x25c454990262dfe9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.686859:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c9067e3/0x25c454990262dfe9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639408.686874:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.686875:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639408.686877:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639408.688588:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.688605:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262dff7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.688642:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.688646:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.688652:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262dff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.688665:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262dff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.688675:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262dff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.688682:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262dff7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.688698:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639408.688707:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.688712:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262dff7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.688719:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.688723:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262dff7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.688732:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262dff7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.688751:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262dff7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.688759:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262dff7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.688773:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.688775:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.688776:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788639408.689173:0:24307:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1788639408.689211:0:24307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788639408.689371:0:24311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22827:x1875523773127296:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11650us (14224us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788639408.689381:0:24311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788639408.689458:0:22827:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788639408.689466:0:22827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380297100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22827:1875523773127296:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788639408.689481:0:22827:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00002000:00010000:3.0:1788639408.691669:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.691682:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262dffe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.691696:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.691700:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.691706:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262dffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.691719:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262dffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.691728:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262dffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.691751:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262dffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.691767:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639408.691777:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.691781:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262dffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.691788:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9fc00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.691793:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262dffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.691801:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262dffe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.691815:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262dffe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.691821:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262dffe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.691836:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.691838:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.691839:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639408.693692:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639408.693703:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262e005 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.693717:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=667s v=(0 0) 00010000:00010000:0.0:1788639408.693722:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639408.693727:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262e005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.693740:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262e005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.693760:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262e005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.693768:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262e005 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.693787:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639408.695524:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639408.695540:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262e005 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.695551:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dce00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639408.695556:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262e005 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.695565:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262e005 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.695584:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262e005 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.695594:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7cb60b6/0x25c454990262e005 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.695613:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.695630:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639408.695632:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639408.699539:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.699553:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262e00c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.699568:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.699573:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.699579:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262e00c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.699610:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262e00c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.699648:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262e00c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.699661:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262e00c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.699682:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.699790:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.699798:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262e00c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.699809:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.699814:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262e00c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.699825:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262e00c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.699842:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262e00c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.699848:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262e00c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.699866:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.699873:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.699875:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639408.700391:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.700400:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262e013 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.700792:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.700795:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.700800:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262e013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.700812:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262e013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.700822:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262e013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.700843:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262e013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.700873:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.701166:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.701173:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262e013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.701181:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ee00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.701186:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262e013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.701195:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262e013 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.701209:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262e013 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.701217:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262e013 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.701236:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.701238:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.701240:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639408.702088:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.702098:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262e01a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.702110:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.702113:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.702118:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262e01a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.702128:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262e01a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.702137:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262e01a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.702144:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262e01a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.702170:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639408.702690:0:22791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.702697:0:22791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262e01a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.702706:0:22791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9fc00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.702710:0:22791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262e01a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.702728:0:22791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262e01a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.702741:0:22791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262e01a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.702749:0:22791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262e01a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.702769:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.702770:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.702772:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639408.703103:0:24313:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639408.703110:0:24313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262e021 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.703125:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=667s v=(0 0) 00010000:00010000:3.0:1788639408.703128:0:24313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639408.703132:0:24313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262e021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.703142:0:24313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262e021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.703151:0:24313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262e021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.703157:0:24313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262e021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639408.703176:0:24313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788639408.703589:0:24313:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788639408.703722:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22829:x1875523773126400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 131923us (132244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639408.703733:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639408.704589:0:22829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22829:1875523773126400:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788639408.704608:0:22829:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788639408.704675:0:22829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22829:1875523773127424:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788639408.704717:0:22829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639408.704742:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243338480 going to sleep for 11 seconds 00010000:00010000:0.0:1788639408.704759:0:22790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639408.704765:0:22790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262e021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.704775:0:22790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639408.704779:0:22790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262e021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.704805:0:22790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262e021 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.704824:0:22790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262e021 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.704835:0:22790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262e021 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639408.704856:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.704858:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639408.704860:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639408.704939:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773127424 00000100:00100000:2.0:1788639408.704952:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773127424 00000100:00100000:2.0:1788639408.705008:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788639408.705018:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22829:x1875523773127424:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788639408.705053:0:25311:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1788639408.706712:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22829:x1875523773127424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1692us (1990us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788639408.706721:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788639408.706953:0:22829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22829:1875523773127424:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788639408.706968:0:22829:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1788639409.015422:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639410.042182:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639410.869818:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773127552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639410.869884:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639410.870017:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773127552 00000100:00100000:3.0:1788639410.870025:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773127552 00000100:00100000:3.0:1788639410.870091:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788639410.870102:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380297100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773127552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788639410.870130:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788639410.870197:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380297100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773127552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639410.870214:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788639410.870241:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773127552:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788639410.870547:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788639410.872088:0:25484:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788639411.069694:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639411.380910:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773127680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639411.380984:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639411.381127:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773127680 00000100:00100000:3.0:1788639411.381134:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773127680 00000100:00100000:3.0:1788639411.381309:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788639411.381320:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773127680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639411.381352:0:22807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788639411.388145:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773127808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639411.388207:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639411.388398:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773127808 00000100:00100000:0.0:1788639411.388406:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773127808 00000100:00100000:0.0:1788639411.388450:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788639411.388459:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773127808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788639411.388495:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788639411.388554:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773127808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639411.388561:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788639411.388643:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773127808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639411.388663:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773127680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7342us (7674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639411.388673:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788639411.392859:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773127680:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788639411.560925:0:25536:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788639411.561198:0:25536:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788639412.088717:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788639412.267755:0:25586:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788639412.268039:0:25586:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788639412.471964:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639412.472266:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754145536 00000100:00100000:1.0:1788639412.472276:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754145536 00000100:00100000:1.0:1788639412.472327:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 113 00000100:00100000:1.0:1788639412.472335:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2404:x1875523754145536:12345-192.168.206.18@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788639412.472362:0:22794:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 71b2c8b8-7aad-41b4-9260-49d0bb897037@192.168.206.18@tcp t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:1.0:1788639412.472402:0:22794:0:(genops.c:1385:class_connect()) connect: client 71b2c8b8-7aad-41b4-9260-49d0bb897037, cookie 0x25c454990262e028 00000100:00080000:1.0:1788639412.472540:0:22794:0:(import.c:65:import_set_state_nolock()) ffff9ae36f258000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639412.472695:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+5:2404:x1875523754145536:12345-192.168.206.18@tcp:250:mount.lustre.0 Request processed in 358us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639412.472703:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 113 00000100:00100000:0.0:1788639412.484114:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.484230:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754145664 00000100:00100000:2.0:1788639412.484240:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754145664 00000100:00100000:2.0:1788639412.484347:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 114 00000100:00100000:2.0:1788639412.484766:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+5:18086:x1875523754145664:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788639412.484782:0:22795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639412.484799:0:22795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78b000/0x25c454990262e02f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85a2e expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639412.484826:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78b000/0x25c454990262e02f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a2e expref: 6 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639412.484838:0:22795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78b000/0x25c454990262e02f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a2e expref: 6 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639412.484847:0:22795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b000, rc 0) 00000100:00100000:2.0:1788639412.484921:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+6:18086:x1875523754145664:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 565us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639412.484941:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 114 00000100:00100000:0.0:1788639412.489124:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.489307:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754145792 00000100:00100000:2.0:1788639412.489316:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754145792 00000100:00100000:2.0:1788639412.489439:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 115 00000100:00100000:2.0:1788639412.489451:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+6:18086:x1875523754145792:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788639412.489585:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+6:18086:x1875523754145792:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 137us (470us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788639412.489593:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 115 00000100:00100000:3.0:1788639412.491710:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.491911:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754145920 00000100:00100000:2.0:1788639412.491921:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754145920 00000100:00100000:2.0:1788639412.492017:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 116 00000100:00100000:2.0:1788639412.492028:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+6:18086:x1875523754145920:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788639412.492045:0:22795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639412.492065:0:22795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78a400/0x25c454990262e036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85a35 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639412.492095:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78a400/0x25c454990262e036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a35 expref: 7 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639412.492106:0:22795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78a400/0x25c454990262e036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a35 expref: 7 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639412.492115:0:22795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a400, rc 0) 00000100:00100000:2.0:1788639412.492174:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+7:18086:x1875523754145920:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 147us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639412.492181:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 116 00000100:00100000:0.0:1788639412.494157:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.495761:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754146048 00000100:00100000:2.0:1788639412.495776:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754146048 00000100:00100000:2.0:1788639412.495847:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 117 00000100:00100000:2.0:1788639412.495858:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+7:18086:x1875523754146048:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788639412.496305:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+8:18086:x1875523754146048:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 445us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639412.496324:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 117 00000100:00100000:0.0:1788639412.500095:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.500296:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754146176 00000100:00100000:2.0:1788639412.500305:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754146176 00000100:00100000:2.0:1788639412.500360:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 118 00000100:00100000:2.0:1788639412.500371:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae344ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+8:18086:x1875523754146176:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788639412.500652:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae344ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+8:18086:x1875523754146176:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 247us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639412.500661:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 118 00000100:00100000:3.0:1788639412.507317:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.507480:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754146304 00000100:00100000:2.0:1788639412.507490:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754146304 00000100:00100000:2.0:1788639412.507553:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 119 00000100:00100000:2.0:1788639412.507562:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae344eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+8:18104:x1875523754146304:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639412.507733:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae344eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+8:18104:x1875523754146304:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 171us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639412.507741:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 119 00000100:00100000:0.0:1788639412.531794:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.531897:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754146432 00000100:00100000:2.0:1788639412.531908:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754146432 00000100:00100000:2.0:1788639412.531974:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 120 00000100:00100000:2.0:1788639412.531984:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+8:18104:x1875523754146432:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639412.532154:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+8:18104:x1875523754146432:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 171us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639412.532162:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 120 00000100:00100000:0.0:1788639412.539786:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639412.539890:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754146560 00000100:00100000:1.0:1788639412.539899:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754146560 00000100:00100000:1.0:1788639412.539955:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 121 00000100:00100000:1.0:1788639412.539965:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+8:18104:x1875523754146560:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788639412.540132:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+8:18104:x1875523754146560:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 167us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639412.540143:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 121 00000100:00100000:3.0:1788639412.547726:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639412.547802:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754146688 00000100:00100000:0.0:1788639412.547811:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754146688 00000100:00100000:0.0:1788639412.547862:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 122 00000100:00100000:0.0:1788639412.547872:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+8:18086:x1875523754146688:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788639412.547896:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639412.547915:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3748dcc00/0x25c454990262e03d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85a66 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639412.547943:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3748dcc00/0x25c454990262e03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a66 expref: 9 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639412.547959:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3748dcc00/0x25c454990262e03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a66 expref: 9 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639412.547968:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dcc00, rc 0) 00000100:00100000:0.0:1788639412.548029:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dfff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+9:18086:x1875523754146688:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 158us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639412.548036:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 122 00000100:00100000:0.0:1788639412.550643:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.551537:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754146816 00000100:00100000:2.0:1788639412.551547:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754146816 00000100:00100000:2.0:1788639412.551606:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 123 00000100:00100000:2.0:1788639412.551636:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+9:18086:x1875523754146816:12345-192.168.206.18@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788639412.551661:0:22795:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788639412.551682:0:22795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788639412.551686:0:22795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788639412.551689:0:22795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788639412.551704:0:22795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788639412.551708:0:22795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788639412.554166:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+9:18086:x1875523754146816:12345-192.168.206.18@tcp:256:mount.lustre.0 Request processed in 2542us (3539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639412.554179:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 123 00000100:00100000:3.0:1788639412.557999:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639412.558586:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754146944 00000100:00100000:1.0:1788639412.558596:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754146944 00000100:00100000:1.0:1788639412.558737:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:1.0:1788639412.558749:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+9:18086:x1875523754146944:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788639412.558765:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639412.558781:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fa600/0x25c454990262e044 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85a6d expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639412.558808:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fa600/0x25c454990262e044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a6d expref: 10 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639412.558819:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fa600/0x25c454990262e044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a6d expref: 10 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639412.558828:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa600, rc 0) 00000100:00100000:1.0:1788639412.558893:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+10:18086:x1875523754146944:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 146us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639412.558900:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:2.0:1788639412.562160:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639412.562258:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754147072 00000100:00100000:0.0:1788639412.562267:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754147072 00000100:00100000:0.0:1788639412.562356:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 125 00000100:00100000:0.0:1788639412.562367:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+10:18086:x1875523754147072:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788639412.562521:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+10:18086:x1875523754147072:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 156us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639412.562537:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 125 00000100:00100000:2.0:1788639412.565022:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639412.565322:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754147200 00000100:00100000:1.0:1788639412.565332:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754147200 00000100:00100000:1.0:1788639412.565389:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 126 00000100:00100000:1.0:1788639412.565399:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+10:18086:x1875523754147200:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788639412.565536:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dfff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+10:18086:x1875523754147200:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 138us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639412.565546:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 126 00000100:00100000:3.0:1788639412.569331:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639412.570579:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754147328 00000100:00100000:0.0:1788639412.570591:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754147328 00000100:00100000:0.0:1788639412.570718:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 127 00000100:00100000:0.0:1788639412.570728:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+10:18106:x1875523754147328:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788639412.570888:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+10:18106:x1875523754147328:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 151us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639412.570896:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 127 00000100:00100000:0.0:1788639412.576724:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.577569:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754147456 00000100:00100000:2.0:1788639412.577580:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754147456 00000100:00100000:2.0:1788639412.577711:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 128 00000100:00100000:2.0:1788639412.577723:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+10:18106:x1875523754147456:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639412.577866:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+10:18106:x1875523754147456:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 146us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639412.577889:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 128 00000100:00100000:2.0:1788639412.581392:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.581474:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639412.582032:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754147584 00000100:00100000:1.0:1788639412.582042:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754147584 00000100:00100000:1.0:1788639412.582234:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754147840 00000100:00100000:1.0:1788639412.582238:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754147840 00000100:00100000:1.0:1788639412.582271:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:1.0:1788639412.582278:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1875523754147584:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788639412.582313:0:22804:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f1e69c21-2788-49fc-9d54-7459329ec792@192.168.206.18@tcp t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:1.0:1788639412.582378:0:22804:0:(genops.c:1385:class_connect()) connect: client f1e69c21-2788-49fc-9d54-7459329ec792, cookie 0x25c454990262e04b 00000004:00100000:1.0:1788639412.582400:0:22804:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788639412.582503:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:3.0:1788639412.582511:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2404:x1875523754147840:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788639412.582530:0:24188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f1e69c21-2788-49fc-9d54-7459329ec792@192.168.206.18@tcp t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:3.0:1788639412.582569:0:24188:0:(genops.c:1385:class_connect()) connect: client f1e69c21-2788-49fc-9d54-7459329ec792, cookie 0x25c454990262e052 00000004:00100000:3.0:1788639412.582593:0:24188:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788639412.582693:0:22804:0:(import.c:65:import_set_state_nolock()) ffff9ae36f25a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639412.582760:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+6:2404:x1875523754147584:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 479us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639412.582771:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00080000:3.0:1788639412.582818:0:24188:0:(import.c:65:import_set_state_nolock()) ffff9ae36f226800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639412.582851:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+6:2404:x1875523754147840:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 339us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639412.582859:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:3.0:1788639412.586196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639412.586237:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639412.586401:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754147712 00000100:00100000:1.0:1788639412.586410:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754147712 00000100:00100000:0.0:1788639412.586546:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754148096 00000100:00100000:0.0:1788639412.586552:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754148096 00000100:00100000:1.0:1788639412.586594:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:1.0:1788639412.586604:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+6:0:x1875523754147712:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788639412.586663:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788639412.586938:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+6:0:x1875523754147712:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 335us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639412.586945:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00080000:2.0:1788639412.587055:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639412.587791:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:0.0:1788639412.587800:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+6:18086:x1875523754148096:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788639412.587820:0:22802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788639412.587864:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+6:18086:x1875523754148096:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 65us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639412.587893:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:3.0:1788639412.587977:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.588523:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754147968 00000100:00100000:2.0:1788639412.588537:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754147968 00000100:00100000:2.0:1788639412.588584:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:2.0:1788639412.588592:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+6:0:x1875523754147968:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788639412.588613:0:22803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788639412.588688:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+6:0:x1875523754147968:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 97us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639412.588694:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00080000:3.0:1788639412.588996:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639412.590815:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639412.591026:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754148224 00000100:00100000:2.0:1788639412.591035:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754148224 00000100:00100000:2.0:1788639412.591094:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:2.0:1788639412.591104:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+6:18086:x1875523754148224:12345-192.168.206.18@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788639412.591180:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+6:18086:x1875523754148224:12345-192.168.206.18@tcp:40:mount.lustre.0 Request processed in 76us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639412.591186:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:2.0:1788639412.594164:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639412.594865:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754148352 00000100:00100000:3.0:1788639412.594940:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754148352 00000100:00100000:2.0:1788639412.595081:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:2.0:1788639412.595090:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2404:x1875523754148352:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788639412.595128:0:24846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f1e69c21-2788-49fc-9d54-7459329ec792@192.168.206.18@tcp t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:2.0:1788639412.595159:0:24846:0:(genops.c:1385:class_connect()) connect: client f1e69c21-2788-49fc-9d54-7459329ec792, cookie 0x25c454990262e059 00002000:00100000:2.0:1788639412.595176:0:24846:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f1e69c21-2788-49fc-9d54-7459329ec792/ffff9ae243aa9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788639412.595192:0:24846:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788639412.595736:0:24846:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788639412.595767:0:24846:0:(import.c:65:import_set_state_nolock()) ffff9ae243aad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788639412.595893:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e69c21-2788-49fc-9d54-7459329ec792+6:2404:x1875523754148352:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 789us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639412.595916:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:0.0:1788639412.599862:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639412.599918:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639412.600191:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754148608 00000100:00100000:1.0:1788639412.600441:0:22813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754148608 00000100:00100000:1.0:1788639412.600502:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:1.0:1788639412.600528:0:22813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f1e69c21-2788-49fc-9d54-7459329ec792+6:18086:x1875523754148608:12345-192.168.206.18@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788639412.600606:0:22813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f1e69c21-2788-49fc-9d54-7459329ec792+6:18086:x1875523754148608:12345-192.168.206.18@tcp:900:mount.lustre.0 Request processed in 82us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639412.600645:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:2.0:1788639412.601693:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754148480 00000100:00100000:2.0:1788639412.601702:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754148480 00000100:00100000:2.0:1788639412.601738:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:2.0:1788639412.601745:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2404:x1875523754148480:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788639412.601771:0:24313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f1e69c21-2788-49fc-9d54-7459329ec792@192.168.206.18@tcp t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:2.0:1788639412.601800:0:24313:0:(genops.c:1385:class_connect()) connect: client f1e69c21-2788-49fc-9d54-7459329ec792, cookie 0x25c454990262e060 00002000:00100000:2.0:1788639412.601810:0:24313:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f1e69c21-2788-49fc-9d54-7459329ec792/ffff9ae243aa9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788639412.601825:0:24313:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788639412.601993:0:24313:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788639412.602021:0:24313:0:(import.c:65:import_set_state_nolock()) ffff9ae367fce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788639412.602074:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e69c21-2788-49fc-9d54-7459329ec792+6:2404:x1875523754148480:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 328us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639412.602081:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:0.0:1788639412.603327:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639412.603692:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754148736 00000100:00100000:3.0:1788639412.603704:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754148736 00000100:00100000:3.0:1788639412.603838:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:3.0:1788639412.603851:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+6:18086:x1875523754148736:12345-192.168.206.18@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788639412.606063:0:22805:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2087us 00000004:00200000:0.0:1788639412.624326:0:22805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788639412.624486:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+6:18086:x1875523754148736:12345-192.168.206.18@tcp:33:mount.lustre.0 Request processed in 20633us (21165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639412.624501:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:1.0:1788639412.763602:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639412.763797:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754148864 00000100:00100000:0.0:1788639412.763807:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754148864 00000100:00100000:0.0:1788639412.764075:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:0.0:1788639412.764087:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+6:18130:x1875523754148864:12345-192.168.206.18@tcp:101:mkdir.0 00010000:00010000:0.0:1788639412.764107:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639412.764131:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85a9e expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639412.764195:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e06e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639412.764208:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e06e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639412.764222:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e06e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639412.764265:0:22802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788639412.764269:0:22802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639412.764304:0:22802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e06e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639412.765753:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a9e expref: 8 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639412.765776:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e06e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a9e expref: 7 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639412.765784:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:0.0:1788639412.765786:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788639412.765790:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dce00, rc 0) 00000100:00100000:0.0:1788639412.765871:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+7:18130:x1875523754148864:12345-192.168.206.18@tcp:101:mkdir.0 Request processed in 1786us (2276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639412.765888:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00010000:00010000:0.0:1788639413.109489:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639413.940909:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639413.940936:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773127936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639413.941009:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639413.941296:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639413.941307:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3505d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773128064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639413.941338:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639413.941373:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773127936 00000100:00100000:2.0:1788639413.941383:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773127936 00000100:00100000:1.0:1788639413.941386:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773128064 00000100:00100000:1.0:1788639413.941392:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773128064 00000100:00100000:2.0:1788639413.941436:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788639413.941446:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773128064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639413.941470:0:24315:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00080000:3.0:1788639413.941518:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788639413.941523:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639413.941531:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773128064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639413.941827:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773128576:0@lo:400:kworker.0 00000100:00100000:3.0:1788639413.941857:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639413.941890:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773129088:0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.942261:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a452a6f1-70bc-4918-a445-81111879f6e1:3644:1875523773128320:0@lo:400:kworker.0 00000100:00100000:3.0:1788639413.942371:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639413.942423:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639413.942449:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773128832:0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.942471:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639413.942490:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773129344:0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.942521:0:24312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773128576 00000100:00100000:0.0:1788639413.942527:0:24312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773128576 00000100:00100000:0.0:1788639413.942584:0:24312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788639413.942593:0:24312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875523773128576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.942680:0:24312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875523773128576:12345-0@lo:400:kworker.0 Request processed in 87us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639413.942686:0:24312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788639413.942719:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773128832 00000100:00100000:0.0:1788639413.942723:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773128832 00000100:00100000:0.0:1788639413.942747:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788639413.942753:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773128832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.942790:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773128832:12345-0@lo:400:kworker.0 Request processed in 37us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639413.942797:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788639413.942815:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639413.942842:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773128320 00000100:00100000:0.0:1788639413.942845:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773128320 00000100:00100000:0.0:1788639413.942880:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788639413.942887:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:3644:x1875523773128320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.942921:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:3644:x1875523773128320:12345-0@lo:400:kworker.0 Request processed in 35us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639413.942927:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788639413.942978:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773128192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639413.943002:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639413.943015:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773128704:0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.943040:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773128448:0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.943062:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639413.943080:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773128960:0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.943101:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639413.943119:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773129472:0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.943311:0:24311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773128960 00000100:00100000:0.0:1788639413.943315:0:24311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773128960 00000100:00100000:0.0:1788639413.943345:0:24311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788639413.943358:0:24311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773128960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.943393:0:24311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773128960:12345-0@lo:400:kworker.0 Request processed in 36us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639413.943399:0:24311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788639413.943415:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773129088 00000100:00100000:0.0:1788639413.943418:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773129088 00000100:00100000:0.0:1788639413.943440:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788639413.943445:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773129088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.943471:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773129088:12345-0@lo:400:kworker.0 Request processed in 26us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639413.943476:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788639413.943490:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639413.943526:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773128448 00000100:00100000:0.0:1788639413.943529:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773128448 00000100:00100000:0.0:1788639413.943550:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788639413.943555:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773128448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.943584:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773128448:12345-0@lo:400:kworker.0 Request processed in 28us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639413.943589:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788639413.944796:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788639413.944801:0:24314:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788639413.944813:0:24314:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788639413.944824:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773128192 00000100:00100000:2.0:1788639413.944831:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773128192 00000100:00100000:2.0:1788639413.944859:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788639413.944893:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773127936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639413.944917:0:24315:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788639413.945047:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788639413.945066:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773128192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788639413.945078:0:25599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788639413.945088:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773129088:0@lo:400:kworker.0 00000100:00100000:2.0:1788639413.945104:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773127936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 213us (4094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639413.945106:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773129600:0@lo:400:kworker.0 00000100:00100000:2.0:1788639413.945120:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788639413.945121:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773128192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639413.945130:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788639413.945170:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639413.945200:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639413.945604:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773128704 00000100:00100000:0.0:1788639413.945610:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773128704 00000100:00100000:0.0:1788639413.945660:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773129472 00000100:00100000:0.0:1788639413.946118:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773129472 00000100:00100000:1.0:1788639413.946384:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3505d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773128064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639413.946482:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788639413.946489:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773128448:0@lo:400:kworker.0 00000100:00100000:0.0:1788639413.946496:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773128704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639413.946508:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773128960:0@lo:400:kworker.0 00000100:00080000:1.0:1788639413.946555:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639413.946557:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773128704:12345-0@lo:400:kworker.0 Request processed in 65us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639413.946571:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788639413.946580:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773129472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639413.946650:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773129472:12345-0@lo:400:kworker.0 Request processed in 71us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639413.946658:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788639413.946698:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773129472:0@lo:400:kworker.0 00000100:00100000:2.0:1788639413.946724:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773128704:0@lo:400:kworker.0 00000100:00100000:2.0:1788639413.946740:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773129216:0@lo:400:kworker.0 00000100:00100000:3.0:1788639413.946996:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639413.947045:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773129600 00000100:00100000:0.0:1788639413.947051:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788639413.947052:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773129600 00000100:00100000:3.0:1788639413.947087:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773127936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639413.947095:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788639413.947105:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773129600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639413.947134:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773128576:0@lo:400:kworker.0 00000100:00100000:1.0:1788639413.947147:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773129600:12345-0@lo:400:kworker.0 Request processed in 43us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639413.947154:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788639413.947170:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788639413.947203:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f39f80 x1875523773129600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639413.947214:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773129600:0@lo:400:kworker.0 00000100:00100000:2.0:1788639413.947356:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639413.947410:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a452a6f1-70bc-4918-a445-81111879f6e1:3644:1875523773128320:0@lo:400:kworker.0 00000100:00100000:2.0:1788639413.947424:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773128832:0@lo:400:kworker.0 00000100:00100000:2.0:1788639413.947444:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639413.947468:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773129344 00000100:00100000:1.0:1788639413.947474:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773129344 00000100:00100000:2.0:1788639413.947506:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773128192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639413.947508:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773129216 00000100:00100000:1.0:1788639413.947513:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773129216 00000100:00100000:1.0:1788639413.947539:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788639413.947547:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773129344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639413.947894:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773129344:12345-0@lo:400:kworker.0 Request processed in 347us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639413.947901:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788639413.947996:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788639413.948011:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773129216:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788639413.948046:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788639413.948051:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639413.948069:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773129216:12345-0@lo:400:kworker.0 Request processed in 64us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639413.948077:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788639413.948191:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f38380 x1875523773129344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639413.948203:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773129344:0@lo:400:kworker.0 00000100:00100000:2.0:1788639413.948234:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773129216:0@lo:400:kworker.0 00000001:00100000:0.0:1788639413.948449:0:25127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f1e69c21-2788-49fc-9d54-7459329ec792 00000001:00080000:0.0:1788639413.948460:0:25127:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1788639414.135056:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639414.525785:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.525858:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754148992 00000100:00100000:1.0:1788639414.525882:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754148992 00000100:00100000:1.0:1788639414.525978:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:1.0:1788639414.525989:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+7:18182:x1875523754148992:12345-192.168.206.18@tcp:41:lfs.0 00000004:00000024:1.0:1788639414.526046:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788639414.526254:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+7:18182:x1875523754148992:12345-192.168.206.18@tcp:41:lfs.0 Request processed in 265us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.526262:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00080000:2.0:1788639414.526347:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639414.531716:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.531813:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754149120 00000100:00100000:1.0:1788639414.531826:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754149120 00000100:00100000:1.0:1788639414.531922:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:1.0:1788639414.531932:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+6:18182:x1875523754149120:12345-192.168.206.18@tcp:41:lfs.0 00000004:00000024:1.0:1788639414.531969:0:22803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788639414.532059:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+6:18182:x1875523754149120:12345-192.168.206.18@tcp:41:lfs.0 Request processed in 129us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.532068:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00080000:2.0:1788639414.532162:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639414.534961:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.535051:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754149248 00000100:00100000:1.0:1788639414.535060:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754149248 00000100:00080000:2.0:1788639414.535231:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639414.535248:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:3.0:1788639414.535270:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e69c21-2788-49fc-9d54-7459329ec792+6:18182:x1875523754149248:12345-192.168.206.18@tcp:13:lfs.0 00002000:00000024:3.0:1788639414.535312:0:24315:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788639414.535481:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e69c21-2788-49fc-9d54-7459329ec792+6:18182:x1875523754149248:12345-192.168.206.18@tcp:13:lfs.0 Request processed in 220us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639414.535489:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:3.0:1788639414.543281:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.543365:0:25599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754149376 00000100:00100000:1.0:1788639414.543376:0:25599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754149376 00000100:00100000:1.0:1788639414.543446:0:25599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:1.0:1788639414.543457:0:25599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e69c21-2788-49fc-9d54-7459329ec792+5:18182:x1875523754149376:12345-192.168.206.18@tcp:13:lfs.0 00002000:00000024:1.0:1788639414.543488:0:25599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788639414.543589:0:25599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f1e69c21-2788-49fc-9d54-7459329ec792+5:18182:x1875523754149376:12345-192.168.206.18@tcp:13:lfs.0 Request processed in 135us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.543596:0:25599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00080000:2.0:1788639414.543748:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639414.704153:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639414.705300:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754149504 00000100:00100000:2.0:1788639414.705344:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754149504 00000100:00100000:2.0:1788639414.705587:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 130 00000100:00100000:2.0:1788639414.705602:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+10:18216:x1875523754149504:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788639414.705639:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639414.705662:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78ae00/0x25c454990262e075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85aa5 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639414.705697:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78ae00/0x25c454990262e075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85aa5 expref: 11 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639414.705710:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78ae00/0x25c454990262e075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85aa5 expref: 11 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639414.705721:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78ae00, rc 0) 00000100:00100000:2.0:1788639414.705800:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18216:x1875523754149504:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 202us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639414.708901:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 130 00000100:00100000:0.0:1788639414.713792:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.715216:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754149632 00000100:00100000:1.0:1788639414.715234:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754149632 00000100:00100000:1.0:1788639414.715316:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 131 00000100:00100000:1.0:1788639414.715329:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18216:x1875523754149632:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788639414.715772:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18216:x1875523754149632:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 445us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.715780:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 131 00000100:00100000:3.0:1788639414.719884:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639414.719990:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754149760 00000100:00100000:2.0:1788639414.720005:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754149760 00000100:00100000:2.0:1788639414.720160:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 132 00000100:00100000:2.0:1788639414.720173:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b56cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18216:x1875523754149760:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788639414.720794:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b56cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18216:x1875523754149760:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 621us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639414.720804:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 132 00000100:00100000:0.0:1788639414.724322:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.724793:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754149888 00000100:00100000:1.0:1788639414.724807:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754149888 00000100:00100000:1.0:1788639414.724985:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 133 00000100:00100000:1.0:1788639414.724998:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18222:x1875523754149888:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788639414.725205:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18222:x1875523754149888:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 209us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.725213:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 133 00000100:00100000:0.0:1788639414.744331:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639414.744955:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754150016 00000100:00100000:2.0:1788639414.744970:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754150016 00000100:00100000:2.0:1788639414.745088:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 134 00000100:00100000:2.0:1788639414.745101:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18222:x1875523754150016:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639414.745289:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18222:x1875523754150016:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 190us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639414.745298:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 134 00000100:00100000:3.0:1788639414.749932:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.750661:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754150144 00000100:00100000:1.0:1788639414.750676:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754150144 00000100:00100000:1.0:1788639414.750749:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 135 00000100:00100000:1.0:1788639414.750761:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18222:x1875523754150144:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788639414.750994:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18222:x1875523754150144:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 234us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.751003:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 135 00000100:00100000:3.0:1788639414.753763:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639414.756014:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754150272 00000100:00100000:2.0:1788639414.756049:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754150272 00000100:00100000:2.0:1788639414.756148:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 136 00000100:00100000:2.0:1788639414.756230:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18216:x1875523754150272:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788639414.756267:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639414.756292:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78b600/0x25c454990262e07c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85ad6 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639414.756500:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78b600/0x25c454990262e07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ad6 expref: 12 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639414.756518:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78b600/0x25c454990262e07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ad6 expref: 12 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639414.756530:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b600, rc 0) 00000100:00100000:2.0:1788639414.756750:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:18216:x1875523754150272:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 590us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639414.756759:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 136 00000100:00100000:2.0:1788639414.759200:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639414.761588:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754150400 00000100:00100000:0.0:1788639414.761608:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754150400 00000100:00100000:0.0:1788639414.761705:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 137 00000100:00100000:0.0:1788639414.761727:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:18216:x1875523754150400:12345-192.168.206.18@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788639414.761760:0:22795:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788639414.761790:0:22795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788639414.761795:0:22795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788639414.761811:0:22795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788639414.761814:0:22795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788639414.761817:0:22795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788639414.765766:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:18216:x1875523754150400:12345-192.168.206.18@tcp:256:mount.lustre.0 Request processed in 4027us (6563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639414.765784:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 137 00000100:00100000:3.0:1788639414.771397:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639414.771543:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754150528 00000100:00100000:2.0:1788639414.771556:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754150528 00000100:00100000:2.0:1788639414.771724:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 138 00000100:00100000:2.0:1788639414.771737:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:18216:x1875523754150528:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788639414.771779:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639414.771814:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78b400/0x25c454990262e083 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85add expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639414.771852:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78b400/0x25c454990262e083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85add expref: 13 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639414.771874:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78b400/0x25c454990262e083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85add expref: 13 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639414.771886:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b400, rc 0) 00000100:00100000:2.0:1788639414.773799:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18216:x1875523754150528:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 2050us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639414.773812:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 138 00000100:00100000:2.0:1788639414.776378:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639414.776549:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754150656 00000100:00100000:0.0:1788639414.776562:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754150656 00000100:00100000:0.0:1788639414.776657:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 139 00000100:00100000:0.0:1788639414.776669:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18216:x1875523754150656:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788639414.777310:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18216:x1875523754150656:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 641us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639414.777335:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 139 00000100:00100000:3.0:1788639414.779171:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639414.779390:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754150784 00000100:00100000:2.0:1788639414.779402:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754150784 00000100:00100000:2.0:1788639414.779469:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 140 00000100:00100000:2.0:1788639414.779480:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18216:x1875523754150784:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788639414.779688:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18216:x1875523754150784:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 209us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639414.779696:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 140 00000100:00100000:3.0:1788639414.782455:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639414.782854:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754150912 00000100:00100000:0.0:1788639414.782879:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754150912 00000100:00100000:0.0:1788639414.783230:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 141 00000100:00100000:0.0:1788639414.783244:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18228:x1875523754150912:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788639414.783446:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18228:x1875523754150912:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 205us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639414.783454:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 141 00000100:00100000:0.0:1788639414.785496:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.785611:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754151040 00000100:00100000:1.0:1788639414.785659:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754151040 00000100:00100000:1.0:1788639414.785854:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 142 00000100:00100000:1.0:1788639414.785877:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18228:x1875523754151040:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788639414.786119:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18228:x1875523754151040:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 253us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.786128:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 142 00000100:00100000:3.0:1788639414.794123:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.794212:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754151168 00000100:00100000:1.0:1788639414.794226:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754151168 00000100:00100000:3.0:1788639414.794240:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.794287:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754151424 00000100:00100000:1.0:1788639414.794291:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754151424 00000100:00100000:1.0:1788639414.794321:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:1.0:1788639414.794330:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2404:x1875523754151168:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788639414.794371:0:24188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a83c22d7-5407-4056-8946-d5050573f0a0@192.168.206.18@tcp t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:1.0:1788639414.794670:0:24188:0:(genops.c:1385:class_connect()) connect: client a83c22d7-5407-4056-8946-d5050573f0a0, cookie 0x25c454990262e08a 00000004:00100000:1.0:1788639414.794704:0:24188:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788639414.794819:0:24188:0:(import.c:65:import_set_state_nolock()) ffff9ae3576e7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788639414.794958:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:0.0:1788639414.795603:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2404:x1875523754151424:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788639414.795675:0:22802:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a83c22d7-5407-4056-8946-d5050573f0a0@192.168.206.18@tcp t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:0.0:1788639414.795713:0:22802:0:(genops.c:1385:class_connect()) connect: client a83c22d7-5407-4056-8946-d5050573f0a0, cookie 0x25c454990262e091 00000004:00100000:0.0:1788639414.795737:0:22802:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788639414.795816:0:22802:0:(import.c:65:import_set_state_nolock()) ffff9ae241e9c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788639414.796197:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+6:2404:x1875523754151424:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 1228us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639414.796208:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:1.0:1788639414.796794:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a83c22d7-5407-4056-8946-d5050573f0a0+6:2404:x1875523754151168:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 2459us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.796805:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:3.0:1788639414.802389:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639414.802525:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639414.806322:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.808279:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754151680 00000100:00100000:1.0:1788639414.808300:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754151680 00000100:00100000:1.0:1788639414.808407:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754151552 00000100:00100000:1.0:1788639414.808411:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754151552 00000100:00100000:1.0:1788639414.808451:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:1.0:1788639414.808462:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a83c22d7-5407-4056-8946-d5050573f0a0+6:18216:x1875523754151680:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788639414.808501:0:22803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788639414.808595:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a83c22d7-5407-4056-8946-d5050573f0a0+6:18216:x1875523754151680:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 134us (6220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.808603:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:1.0:1788639414.808642:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:1.0:1788639414.808649:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a83c22d7-5407-4056-8946-d5050573f0a0+6:0:x1875523754151552:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788639414.808662:0:22803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788639414.808712:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a83c22d7-5407-4056-8946-d5050573f0a0+6:0:x1875523754151552:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 63us (6187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.808719:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00080000:0.0:1788639414.809090:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788639414.809096:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639414.809543:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754151296 00000100:00100000:1.0:1788639414.809551:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754151296 00000100:00100000:1.0:1788639414.809595:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:1.0:1788639414.809605:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a83c22d7-5407-4056-8946-d5050573f0a0+6:0:x1875523754151296:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788639414.809641:0:22803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788639414.810022:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a83c22d7-5407-4056-8946-d5050573f0a0+6:0:x1875523754151296:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 417us (3712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.810030:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:1.0:1788639414.812181:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639414.812392:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754151808 00000100:00100000:0.0:1788639414.812404:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754151808 00000100:00100000:0.0:1788639414.812470:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:0.0:1788639414.812481:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+6:18216:x1875523754151808:12345-192.168.206.18@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788639414.812609:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+6:18216:x1875523754151808:12345-192.168.206.18@tcp:40:mount.lustre.0 Request processed in 131us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639414.812658:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:0.0:1788639414.817607:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639414.817779:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639414.817958:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639414.818315:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754152192 00000100:00100000:2.0:1788639414.818327:0:22814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754152192 00000100:00100000:2.0:1788639414.818409:0:22814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:2.0:1788639414.818421:0:22814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a83c22d7-5407-4056-8946-d5050573f0a0+6:18216:x1875523754152192:12345-192.168.206.18@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788639414.818537:0:22814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a83c22d7-5407-4056-8946-d5050573f0a0+6:18216:x1875523754152192:12345-192.168.206.18@tcp:900:mount.lustre.0 Request processed in 119us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639414.818546:0:22814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:3.0:1788639414.818891:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754151936 00000100:00100000:3.0:1788639414.818898:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754151936 00000100:00100000:3.0:1788639414.818933:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754152064 00000100:00100000:3.0:1788639414.818936:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754152064 00000100:00100000:3.0:1788639414.818971:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:3.0:1788639414.818977:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2404:x1875523754151936:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788639414.819014:0:25311:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a83c22d7-5407-4056-8946-d5050573f0a0@192.168.206.18@tcp t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:3.0:1788639414.819051:0:25311:0:(genops.c:1385:class_connect()) connect: client a83c22d7-5407-4056-8946-d5050573f0a0, cookie 0x25c454990262e098 00002000:00100000:3.0:1788639414.819067:0:25311:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a83c22d7-5407-4056-8946-d5050573f0a0/ffff9ae36f223800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788639414.819080:0:25311:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788639414.819177:0:25311:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788639414.819224:0:25311:0:(import.c:65:import_set_state_nolock()) ffff9ae36f224000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639414.819265:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a83c22d7-5407-4056-8946-d5050573f0a0+6:2404:x1875523754151936:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 287us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639414.819273:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:3.0:1788639414.819288:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:3.0:1788639414.819293:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2404:x1875523754152064:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788639414.819311:0:25311:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a83c22d7-5407-4056-8946-d5050573f0a0@192.168.206.18@tcp t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:3.0:1788639414.819328:0:25311:0:(genops.c:1385:class_connect()) connect: client a83c22d7-5407-4056-8946-d5050573f0a0, cookie 0x25c454990262e09f 00002000:00100000:3.0:1788639414.819334:0:25311:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a83c22d7-5407-4056-8946-d5050573f0a0/ffff9ae36f220000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788639414.819340:0:25311:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788639414.819406:0:25311:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788639414.819423:0:25311:0:(import.c:65:import_set_state_nolock()) ffff9ae36f226000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639414.819460:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a83c22d7-5407-4056-8946-d5050573f0a0+6:2404:x1875523754152064:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 165us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639414.819466:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:3.0:1788639414.825334:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639414.825526:0:22806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754152320 00000100:00100000:0.0:1788639414.825540:0:22806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754152320 00000100:00100000:0.0:1788639414.825607:0:22806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:0.0:1788639414.825644:0:22806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a83c22d7-5407-4056-8946-d5050573f0a0+6:18216:x1875523754152320:12345-192.168.206.18@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788639414.825766:0:22806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788639414.825878:0:22806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a83c22d7-5407-4056-8946-d5050573f0a0+6:18216:x1875523754152320:12345-192.168.206.18@tcp:33:mount.lustre.0 Request processed in 260us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639414.825888:0:22806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00000001:00100000:2.0:1788639414.826938:0:24307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a83c22d7-5407-4056-8946-d5050573f0a0 00000001:00100000:2.0:1788639414.827026:0:24307:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f1e69c21-2788-49fc-9d54-7459329ec792 00000100:00100000:2.0:1788639414.955609:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639414.955799:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754152448 00000100:00100000:1.0:1788639414.955813:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754152448 00000100:00100000:1.0:1788639414.955927:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:1.0:1788639414.955940:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a83c22d7-5407-4056-8946-d5050573f0a0+6:18251:x1875523754152448:12345-192.168.206.18@tcp:101:mkdir.0 00010000:00010000:1.0:1788639414.955966:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639414.955998:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e0a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b0e expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639414.956085:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639414.956103:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639414.956121:0:22803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639414.956207:0:22803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788639414.956212:0:22803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639414.956237:0:22803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639414.956269:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e0a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b0e expref: 8 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639414.956303:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b0e expref: 7 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639414.956314:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:1.0:1788639414.956318:0:22803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788639414.956322:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa800, rc 0) 00000100:00100000:1.0:1788639414.956395:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a83c22d7-5407-4056-8946-d5050573f0a0+7:18251:x1875523754152448:12345-192.168.206.18@tcp:101:mkdir.0 Request processed in 457us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639414.956403:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00010000:00010000:0.0:1788639415.157020:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788639415.542334:0:22838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788639415.988833:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639415.988855:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773129728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639415.988930:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639415.988977:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773129728 00000100:00100000:2.0:1788639415.988983:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773129728 00000100:00100000:2.0:1788639415.989037:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788639415.989046:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773129728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639415.989066:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788639415.989114:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773129728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639415.989121:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788639415.989144:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639415.989180:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773129728:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788639416.181914:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639416.500943:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639416.500966:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773129856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639416.501030:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639416.501130:0:23543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773129856 00000100:00100000:2.0:1788639416.501138:0:23543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773129856 00000100:00100000:2.0:1788639416.501193:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788639416.501203:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773129856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639416.501235:0:23543:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788639416.501294:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773129856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639416.501314:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788639416.501386:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773129856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639416.501532:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773129984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639416.501567:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639416.501664:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773129984 00000100:00100000:0.0:1788639416.501669:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773129984 00000100:00100000:0.0:1788639416.501700:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788639416.501707:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773129984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788639416.501725:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788639416.501766:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773129984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639416.501781:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788639416.502044:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773129984:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788639417.204995:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788639417.209565:0:25686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1788639417.590241:0:23559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1788639418.038268:0:22782:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a83c22d7-5407-4056-8946-d5050573f0a0 00000001:00100000:1.0:1788639418.038286:0:22782:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f1e69c21-2788-49fc-9d54-7459329ec792 00000001:00100000:0.0:1788639418.040542:0:23535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a83c22d7-5407-4056-8946-d5050573f0a0 00000001:00100000:0.0:1788639418.040799:0:23535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f1e69c21-2788-49fc-9d54-7459329ec792 00010000:00010000:0.0:1788639418.229233:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639419.061228:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639419.061257:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3505d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773130112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639419.062054:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639419.062123:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773130496:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.062149:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773130368:0@lo:400:kworker.0 00000100:00100000:1.0:1788639419.062158:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639419.062183:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773131008:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.062191:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639419.062217:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639419.062235:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773130880:0@lo:400:kworker.0 00000100:00100000:1.0:1788639419.062242:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773131520:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.062268:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639419.062288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639419.062294:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523773131392:0@lo:400:kworker.0 00000100:00100000:1.0:1788639419.062316:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788639419.062324:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773130624:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.062331:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639419.062356:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639419.062360:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788639419.062368:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a452a6f1-70bc-4918-a445-81111879f6e1:3644:1875523773130240:0@lo:400:kworker.0 00000100:00100000:1.0:1788639419.062382:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773131136:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.062403:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639419.062412:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639419.062431:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773130752:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.062474:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639419.062494:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773131264:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.062513:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639419.062528:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773131776:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.062547:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639419.062573:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773130368 00000100:00100000:3.0:1788639419.062581:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773130368 00000100:00100000:3.0:1788639419.062637:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773130880 00000100:00100000:3.0:1788639419.062641:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773130880 00000100:00100000:3.0:1788639419.062664:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788639419.062673:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773130368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.062731:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773130368:12345-0@lo:400:kworker.0 Request processed in 58us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.062746:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788639419.062763:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788639419.062771:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773130880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.062802:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773130880:12345-0@lo:400:kworker.0 Request processed in 33us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.062807:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788639419.062825:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773130496 00000100:00100000:3.0:1788639419.062829:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773130496 00000100:00100000:3.0:1788639419.062883:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773131008 00000100:00100000:3.0:1788639419.062886:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773131008 00000100:00100000:3.0:1788639419.062903:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773130624 00000100:00100000:3.0:1788639419.062906:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773130624 00000100:00100000:3.0:1788639419.062921:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788639419.062926:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773130496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.062958:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773130496:12345-0@lo:400:kworker.0 Request processed in 31us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.062964:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788639419.062979:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788639419.062985:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773131008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.063012:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773131008:12345-0@lo:400:kworker.0 Request processed in 27us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.063017:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788639419.063027:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788639419.063033:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773130624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.063060:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773130624:12345-0@lo:400:kworker.0 Request processed in 27us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.063074:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788639419.063100:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773131520 00000100:00100000:3.0:1788639419.063104:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773131520 00000100:00100000:3.0:1788639419.063128:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773131392 00000100:00100000:3.0:1788639419.063132:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773131392 00000100:00100000:3.0:1788639419.063147:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773130752 00000100:00100000:3.0:1788639419.063149:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773130752 00000100:00100000:2.0:1788639419.063154:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773131264 00000100:00100000:2.0:1788639419.063160:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773131264 00000100:00100000:3.0:1788639419.063161:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773131776 00000100:00100000:3.0:1788639419.063166:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773131776 00000100:00100000:3.0:1788639419.063189:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788639419.063196:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788639419.063198:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773131520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639419.063209:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523773131392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.063238:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773131520:12345-0@lo:400:kworker.0 Request processed in 42us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.063245:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788639419.063261:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523773131392:12345-0@lo:400:kworker.0 Request processed in 54us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.063262:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788639419.063273:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788639419.063274:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773130752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639419.063293:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788639419.063302:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773131264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.063312:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773130752:12345-0@lo:400:kworker.0 Request processed in 40us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.063319:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788639419.063336:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788639419.063341:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773131264:12345-0@lo:400:kworker.0 Request processed in 40us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639419.063348:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788639419.063352:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773131776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639419.063377:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773130240 00000100:00100000:2.0:1788639419.063382:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773130240 00000100:00100000:3.0:1788639419.063388:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773131776:12345-0@lo:400:kworker.0 Request processed in 44us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.063396:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788639419.063415:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639419.063420:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639419.063424:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639419.063424:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788639419.063435:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:3644:x1875523773130240:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788639419.063436:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639419.063449:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639419.063461:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36ce71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773132032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639419.063473:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:3644:x1875523773130240:12345-0@lo:400:kworker.0 Request processed in 40us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639419.063481:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788639419.063498:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639419.063522:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773131648:0@lo:400:kworker.0 00000100:00100000:2.0:1788639419.063530:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773131904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639419.063537:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773130112 00000100:00100000:3.0:1788639419.063542:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773130112 00000100:00100000:1.0:1788639419.063558:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639419.063571:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639419.063573:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773132032 00000100:00100000:3.0:1788639419.063577:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773132032 00000100:00100000:3.0:1788639419.063592:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773131904 00000100:00100000:3.0:1788639419.063595:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773131904 00000100:00100000:2.0:1788639419.063608:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a452a6f1-70bc-4918-a445-81111879f6e1:3644:1875523773130240:0@lo:400:kworker.0 00000100:00100000:1.0:1788639419.063611:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773130496:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.063644:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788639419.063652:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773131008:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.063658:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773130112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639419.063679:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788639419.063719:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773130752:0@lo:400:kworker.0 00000100:00100000:0.0:1788639419.063906:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788639419.064041:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773132032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788639419.064057:0:24315:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788639419.064259:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773131264:0@lo:400:kworker.0 00010000:00080000:2.0:1788639419.064279:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae244125180 x1875523773131776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639419.064282:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773130112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 628us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.064297:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788639419.064301:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773131776:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.064316:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788639419.064318:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773130368:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.064328:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773131904:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639419.064336:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773130880:0@lo:400:kworker.0 00010000:00080000:1.0:1788639419.064338:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae244127800 x1875523773131520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1788639419.064341:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788639419.064352:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523773131392:0@lo:400:kworker.0 00000100:00100000:1.0:1788639419.064358:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773131520:0@lo:400:kworker.0 00000100:00100000:3.0:1788639419.064392:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773131904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.064400:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788639419.064410:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773131904:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788639419.064420:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639419.064757:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3505d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773130112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639419.064802:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788639419.064812:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773130624:0@lo:400:kworker.0 00000100:00100000:1.0:1788639419.064861:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773131136 00000100:00100000:1.0:1788639419.064866:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773131136 00000100:00100000:1.0:1788639419.064899:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788639419.064906:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773131136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639419.064948:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773131136:12345-0@lo:400:kworker.0 Request processed in 43us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639419.064955:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788639419.064977:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773131648 00000100:00100000:1.0:1788639419.064981:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773131648 00000100:00100000:1.0:1788639419.065016:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788639419.065023:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773131648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639419.065054:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773131648:12345-0@lo:400:kworker.0 Request processed in 32us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639419.065060:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788639419.065111:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773131136:0@lo:400:kworker.0 00000100:00100000:1.0:1788639419.065120:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773131648:0@lo:400:kworker.0 00000100:00100000:0.0:1788639419.065391:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773132032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1352us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639419.065398:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788639419.068075:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639419.068133:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36ce71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773132032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788639419.261829:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639419.874460:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639419.874510:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639419.874546:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754152704 00000100:00100000:1.0:1788639419.874553:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639419.874572:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754152704 00000100:00100000:1.0:1788639419.874586:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639419.874651:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639419.874679:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639419.874961:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754152960 00000100:00100000:0.0:1788639419.874967:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754152960 00000100:00100000:0.0:1788639419.875009:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754153472 00000100:00100000:0.0:1788639419.875012:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754153472 00000100:00100000:0.0:1788639419.875040:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:0.0:1788639419.875052:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e69c21-2788-49fc-9d54-7459329ec792+5:2405:x1875523754152960:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639419.875145:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e69c21-2788-49fc-9d54-7459329ec792+5:2405:x1875523754152960:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 95us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639419.875154:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:0.0:1788639419.875197:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:0.0:1788639419.875205:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a83c22d7-5407-4056-8946-d5050573f0a0+5:2405:x1875523754153472:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639419.875233:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a83c22d7-5407-4056-8946-d5050573f0a0+5:2405:x1875523754153472:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639419.875242:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:1.0:1788639419.875280:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639419.875334:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639419.875520:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754153088 00000100:00100000:0.0:1788639419.875526:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754153088 00000100:00100000:0.0:1788639419.875559:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:0.0:1788639419.875566:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e69c21-2788-49fc-9d54-7459329ec792+5:2406:x1875523754153088:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639419.875647:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e69c21-2788-49fc-9d54-7459329ec792+5:2406:x1875523754153088:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 50us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639419.875655:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:2.0:1788639419.876491:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754153216 00000100:00100000:2.0:1788639419.876504:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754153216 00000100:00100000:2.0:1788639419.876542:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754152832 00000100:00100000:2.0:1788639419.876546:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754152832 00000100:00100000:1.0:1788639419.876572:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639419.876785:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754153344 00000100:00100000:2.0:1788639419.876790:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754153344 00000100:00100000:3.0:1788639419.876815:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:3.0:1788639419.876828:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+6:2405:x1875523754152704:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639419.876878:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:2.0:1788639419.876888:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a83c22d7-5407-4056-8946-d5050573f0a0+6:2405:x1875523754153216:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639419.876935:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+6:2405:x1875523754152704:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 109us (2489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.876950:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:3.0:1788639419.876970:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:3.0:1788639419.876977:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+5:2406:x1875523754152832:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639419.877141:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a83c22d7-5407-4056-8946-d5050573f0a0+6:2405:x1875523754153216:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 253us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639419.877198:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754153600 00000100:00100000:0.0:1788639419.877204:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754153600 00000100:00100000:2.0:1788639419.877216:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:2.0:1788639419.877236:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:0.0:1788639419.877246:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:2.0:1788639419.877258:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a83c22d7-5407-4056-8946-d5050573f0a0+5:2406:x1875523754153344:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639419.877260:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a83c22d7-5407-4056-8946-d5050573f0a0+6:2406:x1875523754153600:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639419.877294:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a83c22d7-5407-4056-8946-d5050573f0a0+5:2406:x1875523754153344:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 40us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639419.877302:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:0.0:1788639419.877313:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a83c22d7-5407-4056-8946-d5050573f0a0+6:2406:x1875523754153600:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 56us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639419.877321:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00080000:2.0:1788639419.877328:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639419.877335:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639419.877338:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639419.877341:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639419.877529:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754152576 00000100:00100000:1.0:1788639419.877535:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754152576 00000100:00100000:1.0:1788639419.877575:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 144 00000100:00100000:1.0:1788639419.877584:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:2406:x1875523754152576:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639419.877647:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:2406:x1875523754152576:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 64us (2995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639419.877655:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 144 00000100:00100000:3.0:1788639419.882441:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+5:2406:x1875523754152832:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 5442us (7740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639419.882463:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 42 00000001:00100000:1.0:1788639420.088914:0:25127:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a83c22d7-5407-4056-8946-d5050573f0a0 00010000:00010000:2.0:1788639420.277985:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788639420.565604:0:25833:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd62ee9800 20000000:00000080:1.0:1788639420.565702:0:25833:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae36a0d1c00 uarg=0000000000000000 20000000:01000000:1.0:1788639420.565741:0:25833:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788639420.565746:0:25833:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788639420.565751:0:25833:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788639420.567249:0:25834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788639420.567458:0:25833:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788639420.583200:0:25833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788639420.583588:0:25833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.583636:0:25833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f22000/0x25c454990262dd11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dd0a expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.583647:0:25833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f23a00/0x25c454990262dd1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dd18 expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.583655:0:25833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2421f8c00/0x25c454990262dd5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262dd57 expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.583663:0:25833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f23600/0x25c454990262ddf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262ddf1 expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.583692:0:25833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3750fa600/0x25c454990262e044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a6d expref: 12 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.583702:0:25833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae37f78b400/0x25c454990262e083 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85add expref: 12 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.583711:0:25833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.584692:0:25833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae37f78b400/0x25c454990262e083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85add expref: 12 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.584721:0:25833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae37f78b400/0x25c454990262e083 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85add expref: 12 pid: 22796 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639420.584743:0:25833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132160:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639420.585139:0:25833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3750fa600/0x25c454990262e044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a6d expref: 12 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.585150:0:25833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae3750fa600/0x25c454990262e044 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a6d expref: 12 pid: 22794 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639420.585160:0:25833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132288:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639420.585197:0:25833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f23600/0x25c454990262ddf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262ddf1 expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.585205:0:25833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae242f23600/0x25c454990262ddf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262ddf1 expref: 23 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639420.585234:0:25833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132416:0@lo:104: 00000100:00100000:0.0:1788639420.585284:0:25833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788639420.585343:0:25833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2421f8c00/0x25c454990262dd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262dd57 expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.585355:0:25833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2421f8c00/0x25c454990262dd5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262dd57 expref: 23 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639420.585360:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773132416 00000100:00100000:0.0:1788639420.585367:0:25833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132544:0@lo:104: 00000100:00100000:3.0:1788639420.585377:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773132416 00000100:00100000:0.0:1788639420.585421:0:25833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639420.585440:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773132544 00000100:00100000:3.0:1788639420.585447:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773132544 00010000:00010000:0.0:1788639420.585452:0:25833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f23a00/0x25c454990262dd1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262dd18 expref: 23 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.585464:0:25833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae242f23a00/0x25c454990262dd1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262dd18 expref: 23 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639420.585476:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639420.585482:0:25833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132672:0@lo:104: 00000100:00100000:3.0:1788639420.585494:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+4:25833:x1875523773132416:12345-0@lo:104: 00010000:00010000:3.0:1788639420.585514:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639420.585529:0:25833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788639420.585553:0:25833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f22000/0x25c454990262dd11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262dd0a expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639420.585562:0:25833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae242f22000/0x25c454990262dd11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262dd0a expref: 23 pid: 22796 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639420.585572:0:25833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132800:0@lo:104: 00000100:00100000:0.0:1788639420.585612:0:25833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788639420.585639:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788639420.585649:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+4:25833:x1875523773132416:12345-0@lo:104: Request processed in 160us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639420.585658:0:25833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788639420.585659:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788639420.585686:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773132672 00000100:00100000:3.0:1788639420.585692:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773132672 00000100:00100000:0.0:1788639420.585698:0:25833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132416:0@lo:104: 00000100:00100000:3.0:1788639420.585707:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773132800 00000100:00100000:3.0:1788639420.585715:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773132800 00000100:00100000:3.0:1788639420.585734:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788639420.585741:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+5:25833:x1875523773132544:12345-0@lo:104: 00010000:00010000:3.0:1788639420.585764:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.585827:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788639420.585833:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+5:25833:x1875523773132544:12345-0@lo:104: Request processed in 93us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639420.585849:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788639420.585864:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788639420.585870:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+4:25833:x1875523773132672:12345-0@lo:104: 00010000:00010000:3.0:1788639420.585878:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.585910:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788639420.585915:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+4:25833:x1875523773132672:12345-0@lo:104: Request processed in 46us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639420.585920:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788639420.585931:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788639420.585937:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+3:25833:x1875523773132800:12345-0@lo:104: 00010000:00010000:3.0:1788639420.585944:0:22786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.585967:0:22786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788639420.585972:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a452a6f1-70bc-4918-a445-81111879f6e1+3:25833:x1875523773132800:12345-0@lo:104: Request processed in 36us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639420.585977:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788639420.585997:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788639420.586004:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586016:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9fa00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639420.586020:0:25143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586029:0:25143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639420.586037:0:25143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639420.586042:0:25143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788639420.586075:0:25143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586081:0:25143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639420.586100:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586107:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262ddf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262ddf8 expref: -99 pid: 25126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586122:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788639420.586125:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586131:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639420.586134:0:25143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586152:0:25143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639420.586159:0:25143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639420.586166:0:25143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788639420.586181:0:25143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586187:0:25143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639420.586287:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586296:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8800/0x25c454990262dd57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dd5e expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586306:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788639420.586309:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586314:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639420.586316:0:25143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586323:0:25143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639420.586329:0:25143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639420.586341:0:25143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788639420.586356:0:25143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586362:0:25143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639420.586369:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586375:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f22600/0x25c454990262dd18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dd1f expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586383:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639420.586385:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586390:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dc800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639420.586393:0:25143:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586399:0:25143:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639420.586405:0:25143:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639420.586409:0:25143:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788639420.586420:0:25143:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586425:0:25143:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639420.586436:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586441:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc800/0x25c454990262dd0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262dd11 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586453:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639420.586455:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639420.586457:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639420.586464:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639420.586469:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639420.586487:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773132928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639420.586525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639420.586563:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639420.586568:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773133312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639420.586588:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639420.586640:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773133056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639420.586667:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639420.586692:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639420.586698:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773133184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639420.586716:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639420.586745:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773132928 00000100:00100000:3.0:1788639420.586749:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773132928 00010000:00010000:3.0:1788639420.586770:0:24337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f23600/0x25c454990262ddf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262ddf1 expref: 24 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639420.586785:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773133312 00000100:00100000:3.0:1788639420.586787:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773133312 00010000:00010000:3.0:1788639420.586798:0:24337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f22000/0x25c454990262dd11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dd0a expref: 25 pid: 22796 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639420.586817:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773133056 00000100:00100000:3.0:1788639420.586820:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773133056 00010000:00010000:3.0:1788639420.586831:0:24337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2421f8c00/0x25c454990262dd5e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dd57 expref: 26 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639420.586854:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773133184 00000100:00100000:3.0:1788639420.586856:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773133184 00010000:00010000:3.0:1788639420.586869:0:24337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f23a00/0x25c454990262dd1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dd18 expref: 27 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639420.586881:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788639420.586888:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a452a6f1-70bc-4918-a445-81111879f6e1+27:3642:x1875523773132928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639420.586900:0:24337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639420.586905:0:24337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f23600/0x25c454990262ddf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262ddf1 expref: 27 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586917:0:24337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f23600/0x25c454990262ddf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262ddf1 expref: 27 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586933:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f23600/0x25c454990262ddf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262ddf1 expref: 27 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.586945:0:24337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639420.586982:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a452a6f1-70bc-4918-a445-81111879f6e1+26:3642:x1875523773132928:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639420.586989:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788639420.587008:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788639420.587016:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a452a6f1-70bc-4918-a445-81111879f6e1+25:3642:x1875523773133312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639420.587036:0:24337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639420.587042:0:24337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f22000/0x25c454990262dd11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dd0a expref: 25 pid: 22796 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.587056:0:24337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f22000/0x25c454990262dd11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262dd0a expref: 25 pid: 22796 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639420.587058:0:25833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132544:0@lo:104: 00010000:00010000:3.0:1788639420.587085:0:24337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639420.587090:0:25833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132672:0@lo:104: 00010000:00010000:0.0:1788639420.587107:0:25833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f22000/0x25c454990262dd11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262dd0a expref: 25 pid: 22796 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639420.587126:0:25833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132800:0@lo:104: 00000100:00100000:3.0:1788639420.587127:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a452a6f1-70bc-4918-a445-81111879f6e1+24:3642:x1875523773133312:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639420.587144:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788639420.587162:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788639420.587168:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a452a6f1-70bc-4918-a445-81111879f6e1+23:3643:x1875523773133056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639420.587190:0:24337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639420.587195:0:24337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2421f8c00/0x25c454990262dd5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dd57 expref: 23 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.588929:0:24337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2421f8c00/0x25c454990262dd5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262dd57 expref: 23 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.589035:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2421f8c00/0x25c454990262dd5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262dd57 expref: 23 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.589050:0:24337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639420.589119:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a452a6f1-70bc-4918-a445-81111879f6e1+22:3643:x1875523773133056:12345-0@lo:103:ldlm_bl.0 Request processed in 1949us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639420.589127:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788639420.589154:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788639420.589164:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a452a6f1-70bc-4918-a445-81111879f6e1+21:3643:x1875523773133184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639420.589191:0:24337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639420.589197:0:24337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f23a00/0x25c454990262dd1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262dd18 expref: 21 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.589206:0:24337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f23a00/0x25c454990262dd1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262dd18 expref: 21 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.589217:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f23a00/0x25c454990262dd1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262dd18 expref: 21 pid: 22795 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.589226:0:24337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639420.589247:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a452a6f1-70bc-4918-a445-81111879f6e1+20:3643:x1875523773133184:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639420.589253:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788639420.589305:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773133184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639420.589314:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a452a6f1-70bc-4918-a445-81111879f6e1:3643:1875523773133056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639420.589678:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773133312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639420.589687:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773132928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639420.597585:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639420.597742:0:25833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132160:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639420.597792:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754153728 00000100:00100000:3.0:1788639420.597803:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754153728 00010000:00010000:3.0:1788639420.597854:0:24337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae37f78b400/0x25c454990262e083 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85add expref: 13 pid: 22796 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639420.597900:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:3.0:1788639420.597910:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:2407:x1875523754153728:12345-192.168.206.18@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788639420.598431:0:25833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25833:1875523773132288:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639420.598473:0:25833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.598639:0:24337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639420.598657:0:24337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae37f78b400/0x25c454990262e083 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85add expref: 13 pid: 22796 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.598776:0:24337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae37f78b400/0x25c454990262e083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85add expref: 13 pid: 22796 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.598795:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae37f78b400/0x25c454990262e083 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85add expref: 13 pid: 22796 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.598811:0:24337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639420.598875:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dffe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:2407:x1875523754153728:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 967us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639420.598882:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:1.0:1788639420.599043:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639420.599170:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754153856 00000100:00100000:3.0:1788639420.599176:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754153856 00010000:00010000:3.0:1788639420.599196:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3750fa600/0x25c454990262e044 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a6d expref: 12 pid: 22794 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639420.599275:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:3.0:1788639420.599283:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:2408:x1875523754153856:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639420.599299:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639420.599304:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3750fa600/0x25c454990262e044 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a6d expref: 12 pid: 22794 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.599327:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3750fa600/0x25c454990262e044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a6d expref: 12 pid: 22794 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.599338:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fa600/0x25c454990262e044 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a6d expref: 12 pid: 22794 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.599361:0:22788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.599369:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.599383:0:22788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.599389:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.599407:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.599414:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.599420:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dda00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639420.599425:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.599433:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639420.600526:0:25833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639420.600539:0:25833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.600774:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.600784:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3748dda00/0x25c454990262e0b4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639420.600811:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639420.600880:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:2408:x1875523754153856:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 1594us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639420.600888:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:1.0:1788639421.108962:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639421.108995:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773133440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639421.109064:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639421.109153:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773133440 00000100:00100000:3.0:1788639421.109161:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773133440 00000100:00100000:3.0:1788639421.109215:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788639421.109225:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773133440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788639421.109250:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788639421.109295:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773133440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639421.109302:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788639421.109344:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773133440:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788639421.109688:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788639421.301823:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788639421.620722:0:22799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788639421.620730:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae243aea000 from 13 10000000:01000000:3.0:1788639421.620735:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639421.620781:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262e0bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.620803:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262e0bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.620815:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262e0bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639421.620850:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773133568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639421.620930:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639421.620952:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773133568 00000100:00100000:0.0:1788639421.620960:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773133568 00000100:00100000:3.0:1788639421.620963:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242fb1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788639421.621008:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788639421.621017:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+20:22799:x1875523773133568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639421.621029:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639421.621041:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3748dd800/0x25c454990262e0c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262e0bb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639421.621063:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3748dd800/0x25c454990262e0c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262e0bb expref: 21 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639421.621075:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3748dd800/0x25c454990262e0c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262e0bb expref: 21 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639421.621084:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dd800, rc 0) 00000100:00100000:0.0:1788639421.621124:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+21:22799:x1875523773133568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639421.621130:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788639421.621266:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773133696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639421.621295:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639421.621424:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773133824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639421.621455:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639421.621487:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773133696 00000100:00100000:1.0:1788639421.621491:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773133696 00000100:00100000:1.0:1788639421.621516:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773133824 00000100:00100000:1.0:1788639421.621519:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773133824 00000100:00100000:1.0:1788639421.621532:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788639421.621537:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773133696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639421.621561:0:22807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788639421.623934:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788639421.623951:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773133824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788639421.623985:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788639421.624054:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773133824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (2598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639421.624061:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788639421.624114:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773133568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639421.624248:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262e0bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0c2 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.624263:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262e0bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262e0c2 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639421.624776:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773133952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639421.624816:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639421.625355:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773133952 00000100:00100000:2.0:1788639421.625362:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773133952 00000100:00100000:2.0:1788639421.625523:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788639421.625531:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+21:22799:x1875523773133952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639421.628171:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773133696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639421.628260:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773133824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639421.628840:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773133696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7290us (7532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639421.628852:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788639421.629976:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+21:22799:x1875523773133952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4440us (5154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639421.629988:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788639421.630055:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242fb1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788639421.630079:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773133952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639421.630151:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639421.630199:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639421.630225:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242fb1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788639421.630462:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773134080 00000100:00100000:0.0:1788639421.630468:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773134080 00000100:00100000:0.0:1788639421.631114:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788639421.631127:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+21:22799:x1875523773134080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639421.631259:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+21:22799:x1875523773134080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639421.631266:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788639421.631354:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788639421.636130:0:25846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788639421.639603:0:22799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788639421.639699:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788639421.639727:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262e0bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0c2 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.639738:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9fa00/0x25c454990262e0bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0c2 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639421.639748:0:22799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788639421.639751:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae343ebc800 from 13 10000000:01000000:3.0:1788639421.639753:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639421.639788:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262e0c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.639795:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262e0c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.639805:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262e0c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639421.639842:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639421.639902:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639421.639977:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242fb1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639421.641090:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773134208 00000100:00100000:2.0:1788639421.641101:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773134208 00000100:00100000:2.0:1788639421.641216:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788639421.641227:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+21:22799:x1875523773134208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639421.641241:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639421.641257:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78aa00/0x25c454990262e0d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262e0c9 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.641282:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78aa00/0x25c454990262e0d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262e0c9 expref: 22 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.641311:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78aa00/0x25c454990262e0d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262e0c9 expref: 22 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.641319:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78aa00, rc 0) 00000100:00100000:2.0:1788639421.641390:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+22:22799:x1875523773134208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639421.641397:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788639421.641483:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639421.641500:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262e0c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0d0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.641509:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262e0c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262e0d0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639421.641572:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639421.641612:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639421.647105:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242fb1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788639421.647241:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773134336 00000100:00100000:0.0:1788639421.647251:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773134336 00000100:00100000:0.0:1788639421.647299:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788639421.647308:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+22:22799:x1875523773134336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639421.647840:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+22:22799:x1875523773134336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 521us (6215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639421.647849:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788639421.647942:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639421.647991:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639421.648045:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639421.648074:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242fb1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788639421.649493:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773134464 00000100:00100000:0.0:1788639421.649505:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773134464 00000100:00100000:0.0:1788639421.649547:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788639421.649555:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+22:22799:x1875523773134464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639421.649717:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+22:22799:x1875523773134464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639421.649724:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788639421.649842:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788639421.650814:0:25847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788639421.651076:0:22799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788639421.651095:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788639421.651104:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262e0c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0d0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639421.651123:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262e0c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0d0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639421.651133:0:22799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788639421.651135:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae342c41800 from 13 10000000:01000000:0.0:1788639421.651138:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788639421.651168:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262e0d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639421.651175:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262e0d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639421.651184:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262e0d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639421.651203:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639421.651246:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639421.651283:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788639421.651332:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773134592 00000100:00100000:2.0:1788639421.651338:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773134592 00000100:00100000:2.0:1788639421.651383:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788639421.651392:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+22:22799:x1875523773134592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639421.651403:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639421.651415:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78a600/0x25c454990262e0de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262e0d7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.651438:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78a600/0x25c454990262e0de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262e0d7 expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.651449:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78a600/0x25c454990262e0de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262e0d7 expref: 23 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.651458:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a600, rc 0) 00000100:00100000:2.0:1788639421.651501:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+23:22799:x1875523773134592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639421.651508:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788639421.651646:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639421.651659:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262e0d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0de expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639421.651668:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262e0d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262e0de expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639421.651715:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639421.651740:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639421.651764:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788639421.651827:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773134720 00000100:00100000:2.0:1788639421.651841:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773134720 00000100:00100000:2.0:1788639421.651866:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788639421.651872:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+23:22799:x1875523773134720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639421.651966:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+23:22799:x1875523773134720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639421.651973:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788639421.652039:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639421.652064:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639421.652100:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639421.652126:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788639421.652262:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773134848 00000100:00100000:2.0:1788639421.652267:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773134848 00000100:00100000:2.0:1788639421.652286:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788639421.652291:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+23:22799:x1875523773134848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639421.652467:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+23:22799:x1875523773134848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639421.652474:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788639421.656088:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788639421.661145:0:25848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788639421.662961:0:22799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788639421.662994:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788639421.663005:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262e0d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0de expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.663016:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3748dc400/0x25c454990262e0d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0de expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639421.663028:0:22799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788639421.663030:0:22799:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae36cf54000 from 13 10000000:01000000:3.0:1788639421.663033:0:22799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639421.663068:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262e0e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.663076:0:22799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262e0e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.663086:0:22799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262e0e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639421.663110:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639421.663505:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639421.663545:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242fb1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639421.663606:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773134976 00000100:00100000:2.0:1788639421.663613:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773134976 00000100:00100000:2.0:1788639421.663809:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788639421.663819:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+23:22799:x1875523773134976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639421.663844:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639421.663857:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78a800/0x25c454990262e0ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262e0e5 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.663879:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78a800/0x25c454990262e0ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262e0e5 expref: 24 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.663889:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78a800/0x25c454990262e0ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262e0e5 expref: 24 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.663897:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a800, rc 0) 00000100:00100000:2.0:1788639421.663946:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+24:22799:x1875523773134976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639421.663961:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788639421.663987:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773134976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639421.664001:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262e0e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0ec expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639421.664010:0:22799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262e0e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262e0ec expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639421.664066:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773135104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639421.664099:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639421.664201:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639421.664234:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773135104 00000100:00100000:1.0:1788639421.664239:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773135104 00000100:00100000:1.0:1788639421.664311:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788639421.664320:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:22799:x1875523773135104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639421.664559:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:22799:x1875523773135104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639421.664566:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788639421.664736:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773135104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639421.664767:0:22799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773135232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639421.664805:0:22799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639421.664845:0:22799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639421.664890:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773135232 00000100:00100000:2.0:1788639421.664894:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773135232 00000100:00100000:2.0:1788639421.664954:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788639421.664961:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+24:22799:x1875523773135232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639421.665041:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a452a6f1-70bc-4918-a445-81111879f6e1+24:22799:x1875523773135232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639421.665048:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788639421.665105:0:22799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a452a6f1-70bc-4918-a445-81111879f6e1:22799:1875523773135232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788639421.665836:0:25849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788639421.665882:0:22799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788639421.665899:0:22799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788639421.665915:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262e0e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0ec expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.665925:0:22799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e800/0x25c454990262e0e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262e0ec expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639421.838137:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639421.838230:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754153984 00000100:00100000:2.0:1788639421.838239:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754153984 00000100:00100000:2.0:1788639421.838303:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:2.0:1788639421.838313:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+6:18718:x1875523754153984:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639421.838331:0:24188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639421.838351:0:24188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e0f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b15 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838408:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e0fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838421:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e0fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838432:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e0fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838445:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e101 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838466:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838473:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838541:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262e108 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838549:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262e108 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838556:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262e108 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639421.838580:0:24188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788639421.838583:0:24188:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639421.838637:0:24188:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262e108 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838659:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e0fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838665:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e0fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838672:0:24188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e0fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838677:0:24188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ba00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639421.838681:0:24188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e0fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838694:0:24188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e0fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838705:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:2.0:1788639421.838708:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639421.838712:0:24188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e0fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838719:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e0fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838730:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838736:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e101 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838742:0:24188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e101 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838746:0:24188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78be00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639421.838749:0:24188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e101 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838754:0:24188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e101 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838759:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ae242359a00) 00010000:00010000:2.0:1788639421.838761:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639421.838763:0:24188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e101 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838776:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e101 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838805:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e0f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b15 expref: 8 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838817:0:24188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262e108 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b15 expref: 7 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.838824:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae242359400) 00010000:00010000:2.0:1788639421.838826:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788639421.838839:0:24188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b400, rc 0) 00000100:00100000:2.0:1788639421.838891:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+7:18718:x1875523754153984:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 579us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639421.838898:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00080000:1.0:1788639421.839117:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639421.846346:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639421.846443:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754154112 00000100:00100000:1.0:1788639421.846452:0:22813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754154112 00000100:00100000:1.0:1788639421.846516:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:1.0:1788639421.846526:0:22813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f1e69c21-2788-49fc-9d54-7459329ec792+7:18718:x1875523754154112:12345-192.168.206.18@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788639421.846610:0:22813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f1e69c21-2788-49fc-9d54-7459329ec792+7:18718:x1875523754154112:12345-192.168.206.18@tcp:900:lhsmtool_posix.0 Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639421.846641:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:2.0:1788639421.851990:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639421.852138:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754154368 00000100:00100000:1.0:1788639421.852148:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754154368 00000100:00100000:1.0:1788639421.852249:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:1.0:1788639421.852259:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+7:18718:x1875523754154368:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639421.852280:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639421.852300:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262e10f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b1c expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.852372:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262e116 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.852386:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262e116 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.852414:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262e116 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.852430:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262e11d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.852437:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262e11d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.852444:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262e11d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.852577:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262e124 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.852585:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262e124 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.852592:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262e124 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639421.852601:0:22804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788639421.853143:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262e116 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853153:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262e116 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853160:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262e116 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853166:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639421.853177:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262e116 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853185:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262e116 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853196:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae242359400) 00010000:00010000:1.0:1788639421.853199:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639421.853203:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262e116 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853209:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262e116 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853222:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262e11d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853229:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262e11d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853235:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262e11d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853240:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639421.853242:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262e11d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853248:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262e11d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853424:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ae352893200) 00010000:00010000:1.0:1788639421.853427:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639421.853437:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262e11d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.853449:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262e11d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.855259:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262e10f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b1c expref: 10 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.855283:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262e124 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b1c expref: 9 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.855292:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae352893b00) 00010000:00010000:1.0:1788639421.855295:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639421.855298:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb200, rc 0) 00000100:00100000:1.0:1788639421.855368:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+9:18718:x1875523754154368:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 3109us (3387us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788639421.855376:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:2.0:1788639421.861251:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639421.861338:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754154496 00000100:00100000:3.0:1788639421.861347:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754154496 00000100:00100000:3.0:1788639421.861400:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:3.0:1788639421.861409:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+9:18718:x1875523754154496:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788639421.861498:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+9:18718:x1875523754154496:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 Request processed in 91us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639421.861513:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:0.0:1788639421.872147:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639421.872421:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754154624 00000100:00100000:3.0:1788639421.872431:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754154624 00000100:00080000:1.0:1788639421.872493:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639421.872567:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:3.0:1788639421.872578:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+5:18718:x1875523754154624:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788639421.878437:0:22802:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5817us 00000100:00100000:3.0:1788639421.907174:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+5:18718:x1875523754154624:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 Request processed in 34589us (35026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639421.907189:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:2.0:1788639421.970504:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639421.970596:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754154752 00000100:00100000:3.0:1788639421.970605:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754154752 00000100:00100000:3.0:1788639421.970695:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:3.0:1788639421.970706:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+9:18724:x1875523754154752:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639421.970725:0:24188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639421.970747:0:24188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262e132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b23 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.970804:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e139 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.970838:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.970852:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.970911:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e140 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.970920:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.970927:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.970969:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.970976:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e139 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.970983:0:24188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.970988:0:24188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ee00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639421.970992:0:24188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.970999:0:24188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e139 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971009:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:3.0:1788639421.971018:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639421.971022:0:24188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971028:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971042:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971048:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971054:0:24188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971059:0:24188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639421.971061:0:24188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971067:0:24188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e140 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971074:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ae242373300) 00010000:00010000:3.0:1788639421.971076:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639421.971079:0:24188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e140 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971085:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e140 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971115:0:24188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262e132 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b23 expref: 10 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971131:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:3.0:1788639421.971133:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639421.971137:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262e132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b23 expref: 10 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639421.971146:0:24188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9fc00, rc 0) 00000100:00100000:3.0:1788639421.971195:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+9:18724:x1875523754154752:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 493us (701us total) trans 0 rc 301/301 00000100:00100000:3.0:1788639421.971202:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:2.0:1788639421.981553:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639421.981795:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754154880 00000100:00100000:3.0:1788639421.981805:0:22811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754154880 00000100:00100000:3.0:1788639421.981872:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:3.0:1788639421.981882:0:22811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f1e69c21-2788-49fc-9d54-7459329ec792+9:18724:x1875523754154880:12345-192.168.206.18@tcp:700:lfs.0 00000100:00100000:3.0:1788639421.982043:0:22811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f1e69c21-2788-49fc-9d54-7459329ec792+9:18724:x1875523754154880:12345-192.168.206.18@tcp:700:lfs.0 Request processed in 161us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639421.982051:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:0.0:1788639421.985691:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639421.985814:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754155136 00000100:00100000:2.0:1788639421.985822:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754155136 00000100:00100000:2.0:1788639421.985893:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:2.0:1788639421.985903:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+9:18724:x1875523754155136:12345-192.168.206.18@tcp:36:lfs.0 00010000:00010000:2.0:1788639421.985952:0:22804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639421.985976:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e06e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a9e expref: 9 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.986075:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:2.0:1788639421.986080:0:22804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788639421.986144:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.986158:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b0e expref: 5 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.986166:0:22804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.986198:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b0e expref: 5 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.986210:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b0e expref: 5 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639421.986223:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22804:1875523773135360:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639421.986293:0:22804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343da3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639421.989936:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639421.990010:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754155264 00000100:00100000:2.0:1788639421.990012:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22804:1875523773135360:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639421.990020:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754155264 00010000:00010000:2.0:1788639421.990041:0:22804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.990084:0:22789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b0e expref: 6 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788639421.990092:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639421.990139:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:1.0:1788639421.990150:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a83c22d7-5407-4056-8946-d5050573f0a0+6:2407:x1875523754155264:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639421.990165:0:22789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639421.990172:0:22789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b0e expref: 6 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.990205:0:22789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b0e expref: 6 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.990233:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e0ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b0e expref: 6 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.990249:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:1.0:1788639421.990255:0:22789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.990410:0:22789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.990420:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639421.990451:0:22789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639421.990501:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a83c22d7-5407-4056-8946-d5050573f0a0+5:2407:x1875523754155264:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 353us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639421.990509:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00010000:00010000:2.0:1788639421.990655:0:22804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.990662:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.990690:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.990699:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.990706:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.991881:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.991897:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.991905:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788639421.991922:0:22804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a9895a0 reply state 00000000dc3b5725 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.991932:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.991938:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ae242359700) 00010000:00010000:2.0:1788639421.991942:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788639421.991945:0:22804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788639421.991950:0:22804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788639421.991956:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.991963:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.991976:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.991983:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ba00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639421.991987:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.991996:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.992006:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:2.0:1788639421.992009:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639421.992013:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.992020:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e147 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788639421.992036:0:22804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a9895a0 reply state 00000000dc3b5725 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.992045:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639421.992051:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ae242359a00) 00010000:00010000:2.0:1788639421.992053:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788639421.992055:0:22804:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788639421.992136:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+10:18724:x1875523754155136:12345-192.168.206.18@tcp:36:lfs.0 Request processed in 6232us (6450us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788639421.992145:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:0.0:1788639422.067102:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.067968:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754155392 00000100:00100000:3.0:1788639422.067979:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754155392 00000100:00100000:3.0:1788639422.068041:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:3.0:1788639422.068052:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+10:18732:x1875523754155392:12345-192.168.206.18@tcp:101:lctl.0 00010000:00010000:3.0:1788639422.068076:0:24188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639422.068099:0:24188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262e15c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b2a expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.068181:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e163 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.068195:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.068207:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639422.068251:0:24188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788639422.068255:0:24188:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639422.068290:0:24188:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.068312:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262e15c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b2a expref: 12 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.070047:0:24188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e000/0x25c454990262e163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b2a expref: 11 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.070064:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242373300) 00010000:00010000:3.0:1788639422.070067:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639422.070073:0:24188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9e000, rc 0) 00000100:00100000:3.0:1788639422.070220:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+11:18732:x1875523754155392:12345-192.168.206.18@tcp:101:lctl.0 Request processed in 2165us (3122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639422.070230:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:1.0:1788639422.087760:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.087886:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754155520 00000100:00100000:3.0:1788639422.087896:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754155520 00000100:00100000:3.0:1788639422.087966:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:3.0:1788639422.087977:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+5:18733:x1875523754155520:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639422.087996:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639422.088015:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e16a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b31 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.088074:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262e171 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.088089:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262e171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.088101:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262e171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639422.088140:0:22802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788639422.088144:0:22802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639422.088166:0:22802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262e171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.088190:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262e16a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b31 expref: 7 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.088207:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262e171 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b31 expref: 6 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.088215:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242373300) 00010000:00010000:3.0:1788639422.088217:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639422.088221:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9fc00, rc 0) 00000100:00100000:3.0:1788639422.088283:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+6:18733:x1875523754155520:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 308us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639422.088297:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:0.0:1788639422.090792:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.090881:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754155648 00000100:00100000:3.0:1788639422.090890:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754155648 00000100:00100000:3.0:1788639422.091310:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:3.0:1788639422.091321:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a83c22d7-5407-4056-8946-d5050573f0a0+6:18733:x1875523754155648:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639422.091340:0:24188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639422.091359:0:24188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b38 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091421:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e17f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091435:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e17f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091447:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e17f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091459:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e186 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091468:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091474:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091547:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262e18d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091583:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262e18d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091591:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262e18d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639422.091652:0:24188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788639422.091656:0:24188:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639422.091674:0:24188:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262e18d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091685:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e17f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091692:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e17f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091698:0:24188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e17f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091703:0:24188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639422.091707:0:24188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e17f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091714:0:24188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e17f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091725:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242373300) 00010000:00010000:3.0:1788639422.091728:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639422.091732:0:24188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e17f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091748:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e17f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091761:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091767:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e186 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091773:0:24188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091777:0:24188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639422.091780:0:24188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091786:0:24188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e186 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091793:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ae242359a00) 00010000:00010000:3.0:1788639422.091796:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639422.091799:0:24188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e186 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091805:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e186 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091839:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b38 expref: 8 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091865:0:24188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262e18d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b38 expref: 7 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.091872:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ae242359700) 00010000:00010000:3.0:1788639422.091875:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639422.091877:0:24188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4600, rc 0) 00000100:00100000:3.0:1788639422.091942:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a83c22d7-5407-4056-8946-d5050573f0a0+7:18733:x1875523754155648:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 623us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639422.091949:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:0.0:1788639422.096482:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639422.096550:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754155776 00000100:00100000:1.0:1788639422.096561:0:22813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754155776 00000100:00100000:1.0:1788639422.096661:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:1.0:1788639422.096673:0:22813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a83c22d7-5407-4056-8946-d5050573f0a0+5:18733:x1875523754155776:12345-192.168.206.18@tcp:900:lfs.0 00000100:00100000:1.0:1788639422.096763:0:22813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a83c22d7-5407-4056-8946-d5050573f0a0+5:18733:x1875523754155776:12345-192.168.206.18@tcp:900:lfs.0 Request processed in 92us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639422.096791:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00080000:3.0:1788639422.096911:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639422.101716:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639422.101800:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754156032 00000100:00100000:2.0:1788639422.101819:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754156032 00000100:00100000:2.0:1788639422.101888:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:2.0:1788639422.101898:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a83c22d7-5407-4056-8946-d5050573f0a0+7:18733:x1875523754156032:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639422.101923:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639422.101946:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b3f expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639422.102037:0:22804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788639422.102138:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e194 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b3f expref: 9 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.102155:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242373300) 00010000:00010000:2.0:1788639422.102159:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788639422.102164:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b3f expref: 9 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.102178:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78ba00, rc 0) 00000100:00100000:2.0:1788639422.102232:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a83c22d7-5407-4056-8946-d5050573f0a0+8:18733:x1875523754156032:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 334us (524us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788639422.102239:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:0.0:1788639422.106464:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.106648:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754156288 00000100:00100000:3.0:1788639422.106657:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754156288 00000100:00100000:3.0:1788639422.106717:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:2.0:1788639422.106750:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a83c22d7-5407-4056-8946-d5050573f0a0+8:18733:x1875523754156288:12345-192.168.206.18@tcp:36:lfs.0 00010000:00010000:2.0:1788639422.106805:0:22803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639422.106841:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262e18d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b38 expref: 8 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.106868:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ae242359700) 00010000:00010000:2.0:1788639422.106884:0:22803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788639422.106912:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.106925:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.106935:0:22803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788639422.107113:0:22803:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035bb1b6b reply state 00000000f7585a60 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.107126:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.107133:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ae242359700) 00010000:00010000:2.0:1788639422.107136:0:22803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788639422.107138:0:22803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788639422.107146:0:22803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788639422.107217:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a83c22d7-5407-4056-8946-d5050573f0a0+9:18733:x1875523754156288:12345-192.168.206.18@tcp:36:lfs.0 Request processed in 490us (760us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788639422.107225:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:0.0:1788639422.111226:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.111346:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754156544 00000100:00100000:3.0:1788639422.111355:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754156544 00000100:00100000:3.0:1788639422.111411:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:3.0:1788639422.111421:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a83c22d7-5407-4056-8946-d5050573f0a0+9:18733:x1875523754156544:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:3.0:1788639422.111946:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a83c22d7-5407-4056-8946-d5050573f0a0+10:18733:x1875523754156544:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 515us (717us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788639422.111956:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:1.0:1788639422.117394:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.117481:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754156800 00000100:00100000:3.0:1788639422.117489:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754156800 00000100:00100000:3.0:1788639422.117542:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:3.0:1788639422.117551:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+10:18733:x1875523754156800:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639422.117571:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639422.117600:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b46 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.117703:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.117717:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.117727:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.117738:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.117745:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.117751:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639422.117864:0:22802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788639422.117934:0:22802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.117956:0:22802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.117962:0:22802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.117968:0:22802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639422.117972:0:22802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.117986:0:22802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.117998:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242373300) 00010000:00010000:3.0:1788639422.118000:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639422.118005:0:22802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.118011:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.118023:0:22802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.118029:0:22802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.118036:0:22802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.118041:0:22802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639422.118043:0:22802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.118049:0:22802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.118064:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ae242359a00) 00010000:00010000:3.0:1788639422.118066:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639422.118069:0:22802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.118084:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.118118:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b46 expref: 12 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.118127:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242373300) 00010000:00010000:3.0:1788639422.118129:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788639422.118133:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b46 expref: 12 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.118141:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4800, rc 0) 00000100:00100000:3.0:1788639422.118189:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+11:18733:x1875523754156800:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 639us (802us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1788639422.118198:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:0.0:1788639422.123951:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.124092:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754156928 00000100:00100000:3.0:1788639422.124101:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754156928 00000100:00100000:3.0:1788639422.124157:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:3.0:1788639422.124167:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a83c22d7-5407-4056-8946-d5050573f0a0+11:18733:x1875523754156928:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639422.124189:0:24188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639422.124208:0:24188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e1c5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b4d expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.124298:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.124312:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.124345:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639422.124374:0:24188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788639422.124377:0:24188:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639422.124394:0:24188:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.124420:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e1c5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b4d expref: 13 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.124448:0:24188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b4d expref: 12 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.124457:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ae242359700) 00010000:00010000:3.0:1788639422.124459:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639422.124462:0:24188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5600, rc 0) 00000100:00100000:3.0:1788639422.124518:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a83c22d7-5407-4056-8946-d5050573f0a0+12:18733:x1875523754156928:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 353us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639422.124525:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:0.0:1788639422.129720:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639422.130331:0:22806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754157056 00000100:00100000:2.0:1788639422.130342:0:22806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754157056 00000100:00100000:2.0:1788639422.130396:0:22806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:2.0:1788639422.130406:0:22806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a83c22d7-5407-4056-8946-d5050573f0a0+12:18733:x1875523754157056:12345-192.168.206.18@tcp:37:lfs.0 00000100:00100000:2.0:1788639422.136162:0:22806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a83c22d7-5407-4056-8946-d5050573f0a0+12:18733:x1875523754157056:12345-192.168.206.18@tcp:37:lfs.0 Request processed in 5749us (6440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639422.136175:0:22806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:0.0:1788639422.142260:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.142381:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754157312 00000100:00100000:3.0:1788639422.142391:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754157312 00000100:00100000:3.0:1788639422.142450:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:3.0:1788639422.142461:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae367b7d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a83c22d7-5407-4056-8946-d5050573f0a0+12:18733:x1875523754157312:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:3.0:1788639422.143394:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae367b7d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a83c22d7-5407-4056-8946-d5050573f0a0+13:18733:x1875523754157312:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 931us (1138us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788639422.143403:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:0.0:1788639422.192401:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.193104:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754157440 00000100:00100000:3.0:1788639422.193117:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754157440 00000100:00100000:3.0:1788639422.193193:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:3.0:1788639422.193205:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+11:18739:x1875523754157440:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:3.0:1788639422.193233:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639422.193260:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e1d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b54 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.193488:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.193506:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.193522:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.193535:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.193542:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.193548:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.194029:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1e8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.194043:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.194087:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639422.194132:0:22802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788639422.194137:0:22802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639422.194188:0:22802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.194202:0:22802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.194209:0:22802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.194217:0:22802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.194223:0:22802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639422.194229:0:22802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.194237:0:22802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.194251:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242373300) 00010000:00010000:3.0:1788639422.194255:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639422.194260:0:22802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.194267:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262e1da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.194296:0:22802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.195560:0:22802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.195572:0:22802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.195579:0:22802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639422.195583:0:22802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.195594:0:22802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.195611:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ae242359a00) 00010000:00010000:3.0:1788639422.195640:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639422.195645:0:22802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.195653:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e1e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.195725:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e1d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b54 expref: 13 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.195742:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262e1e8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b54 expref: 12 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.195771:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ae242359700) 00010000:00010000:3.0:1788639422.195774:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788639422.195777:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5c00, rc 0) 00000100:00100000:3.0:1788639422.195869:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+12:18739:x1875523754157440:12345-192.168.206.18@tcp:101:bash.0 Request processed in 2664us (3480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639422.195879:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:1.0:1788639422.201747:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639422.201858:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754157568 00000100:00100000:0.0:1788639422.201871:0:22813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754157568 00000100:00100000:0.0:1788639422.202012:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:0.0:1788639422.202024:0:22813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f1e69c21-2788-49fc-9d54-7459329ec792+5:18739:x1875523754157568:12345-192.168.206.18@tcp:900:bash.0 00000100:00100000:0.0:1788639422.202137:0:22813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f1e69c21-2788-49fc-9d54-7459329ec792+5:18739:x1875523754157568:12345-192.168.206.18@tcp:900:bash.0 Request processed in 114us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639422.202144:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:3.0:1788639422.204509:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639422.204686:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754157824 00000100:00100000:2.0:1788639422.204699:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754157824 00000100:00100000:2.0:1788639422.204840:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 37 00000100:00100000:2.0:1788639422.204853:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+12:18739:x1875523754157824:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639422.204879:0:24188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639422.205298:0:24188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e1ef lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b5b expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.205449:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.205468:0:24188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b4d expref: 12 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.205478:0:24188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.205520:0:24188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b4d expref: 12 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.205536:0:24188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b4d expref: 12 pid: 24188 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639422.205552:0:24188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24188:1875523773135488:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639422.205839:0:24188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343da36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639422.210538:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639422.210659:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754157952 00000100:00100000:0.0:1788639422.210671:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754157952 00010000:00010000:0.0:1788639422.210724:0:22787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b4d expref: 13 pid: 24188 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639422.210769:0:24188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24188:1875523773135488:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639422.210778:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:0.0:1788639422.210790:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a83c22d7-5407-4056-8946-d5050573f0a0+13:2408:x1875523754157952:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639422.210807:0:24188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.210809:0:22787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639422.210821:0:22787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b4d expref: 13 pid: 24188 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.210848:0:22787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b4d expref: 13 pid: 24188 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.214040:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262e1cc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b4d expref: 13 pid: 24188 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.214078:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ae242359700) 00010000:00010000:0.0:1788639422.214085:0:22787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.214099:0:22787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.214109:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.214163:0:22787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639422.214423:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a83c22d7-5407-4056-8946-d5050573f0a0+12:2408:x1875523754157952:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 3632us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639422.214435:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00010000:00010000:2.0:1788639422.216009:0:24188:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.216030:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.216337:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.216361:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.216374:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.216954:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262e204 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.216965:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262e204 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.216974:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262e204 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639422.216985:0:24188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788639422.217010:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.217018:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.217025:0:24188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.217044:0:24188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78be00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639422.217048:0:24188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.217056:0:24188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.217069:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ae242359700) 00010000:00010000:2.0:1788639422.217072:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639422.217076:0:24188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.217083:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e1f6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788639422.217095:0:24188:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a16f5fc reply state 00000000e6a0315b transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.217106:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.217112:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ae242359900) 00010000:00010000:2.0:1788639422.217114:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788639422.217117:0:24188:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788639422.217227:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e1ef lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b5b expref: 15 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.217244:0:24188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262e204 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b5b expref: 14 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.217262:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:2.0:1788639422.217353:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788639422.217357:0:24188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78ac00, rc 0) 00000100:00100000:2.0:1788639422.217409:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+15:18739:x1875523754157824:12345-192.168.206.18@tcp:101:bash.0 Request processed in 12559us (12913us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788639422.217417:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 37 00000100:00100000:3.0:1788639422.231819:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639422.232282:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754158080 00000100:00100000:2.0:1788639422.232297:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754158080 00000100:00100000:2.0:1788639422.232369:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:2.0:1788639422.232379:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+15:18739:x1875523754158080:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639422.232401:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639422.232420:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e212 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b62 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.232486:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.232499:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.232510:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639422.232554:0:22804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788639422.232559:0:22804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639422.232577:0:22804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.232603:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.232670:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262e212 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b62 expref: 17 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.232691:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b62 expref: 16 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.232701:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:2.0:1788639422.232704:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639422.232708:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78be00, rc 0) 00000100:00100000:2.0:1788639422.232772:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+16:18739:x1875523754158080:12345-192.168.206.18@tcp:101:bash.0 Request processed in 394us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639422.232779:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:3.0:1788639422.238800:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639422.238997:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754158336 00000100:00100000:0.0:1788639422.239011:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754158336 00000100:00100000:0.0:1788639422.239077:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:0.0:1788639422.239090:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+16:18739:x1875523754158336:12345-192.168.206.18@tcp:35:bash.0 00000001:00080000:0.0:1788639422.239398:0:22805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:0.0:1788639422.239555:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+18:18739:x1875523754158336:12345-192.168.206.18@tcp:35:bash.0 Request processed in 467us (771us total) trans 12884901898 rc 0/0 00000100:00100000:0.0:1788639422.239565:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00000020:00080000:0.0:1788639422.239572:0:22805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788639422.325666:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639422.326556:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639422.326660:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754158592 00000100:00100000:0.0:1788639422.326682:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754158592 00000100:00100000:0.0:1788639422.326765:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 39 00000100:00100000:0.0:1788639422.326777:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+18:18749:x1875523754158592:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639422.326806:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639422.326843:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b69 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639422.326971:0:22803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788639422.327105:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e220 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b69 expref: 20 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.327123:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242373300) 00010000:00010000:0.0:1788639422.327126:0:22803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788639422.327133:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b69 expref: 20 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.327149:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dda00, rc 0) 00000100:00100000:0.0:1788639422.327237:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+19:18749:x1875523754158592:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 462us (688us total) trans 12884901899 rc 301/301 00000100:00100000:0.0:1788639422.327245:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 39 00000100:00100000:3.0:1788639422.332963:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639422.334952:0:22806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754158848 00000100:00100000:2.0:1788639422.334973:0:22806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754158848 00000100:00100000:2.0:1788639422.335149:0:22806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:2.0:1788639422.335162:0:22806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e69c21-2788-49fc-9d54-7459329ec792+19:18749:x1875523754158848:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:2.0:1788639422.335482:0:22806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e69c21-2788-49fc-9d54-7459329ec792+20:18749:x1875523754158848:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 322us (2602us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788639422.335490:0:22806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:3.0:1788639422.370259:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.370992:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639422.371714:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754158976 00000100:00100000:1.0:1788639422.371729:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754158976 00000100:00100000:1.0:1788639422.371802:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 157 00000100:00100000:1.0:1788639422.371814:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+11:18100:x1875523754158976:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639422.371847:0:22795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639422.371874:0:22795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fbe00/0x25c454990262e22e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b70 expref: -99 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.372029:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fbe00/0x25c454990262e22e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b70 expref: 12 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.372042:0:22795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fbe00/0x25c454990262e22e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b70 expref: 12 pid: 22795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.372053:0:22795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fbe00, rc 0) 00000100:00100000:1.0:1788639422.372155:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:18100:x1875523754158976:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 343us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639422.372162:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 157 00000100:00100000:0.0:1788639422.374856:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754159232 00000100:00100000:0.0:1788639422.374876:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754159232 00000100:00100000:0.0:1788639422.375112:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:0.0:1788639422.375127:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+20:18752:x1875523754159232:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639422.375156:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639422.375182:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e235 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b77 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.375343:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e23c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.375361:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e23c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.375374:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e23c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639422.375401:0:22802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788639422.375543:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e235 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b77 expref: 23 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.375566:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e23c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b77 expref: 22 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.375577:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:0.0:1788639422.375580:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788639422.375584:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dde00, rc 0) 00000100:00100000:0.0:1788639422.375700:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+22:18752:x1875523754159232:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 576us (4712us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788639422.375708:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:1.0:1788639422.385021:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639422.385137:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639422.385220:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639422.385356:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754159616 00000100:00100000:0.0:1788639422.385368:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754159616 00000100:00100000:0.0:1788639422.385456:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:0.0:1788639422.385469:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+22:18752:x1875523754159616:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:0.0:1788639422.385573:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e24a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.385602:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e24a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.385642:0:22803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e24a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.385690:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e24a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.385703:0:22803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e24a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.385711:0:22803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e24a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.385718:0:22803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dda00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639422.385722:0:22803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e24a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.385731:0:22803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e24a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.385745:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:0.0:1788639422.385748:0:22803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788639422.385754:0:22803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e24a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.385761:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e24a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639422.385860:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+22:18752:x1875523754159616:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 393us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639422.385876:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:2.0:1788639422.386861:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754159360 00000100:00100000:2.0:1788639422.386872:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754159360 00000100:00100000:2.0:1788639422.387022:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 158 00000100:00100000:2.0:1788639422.387035:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:18100:x1875523754159360:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639422.387213:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:18100:x1875523754159360:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 180us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639422.387221:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 158 00000100:00100000:3.0:1788639422.387505:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754159488 00000100:00100000:3.0:1788639422.387510:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754159488 00000100:00100000:3.0:1788639422.387557:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:3.0:1788639422.387565:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1e69c21-2788-49fc-9d54-7459329ec792+22:2405:x1875523754159488:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639422.387579:0:24337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639422.387603:0:24337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e23c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b77 expref: 22 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.387635:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:3.0:1788639422.387642:0:24337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639422.387670:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1e69c21-2788-49fc-9d54-7459329ec792+21:2405:x1875523754159488:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 106us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639422.387686:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:0.0:1788639422.388893:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.389330:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754159872 00000100:00100000:3.0:1788639422.389340:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754159872 00000100:00100000:3.0:1788639422.389395:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:3.0:1788639422.389405:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+21:18752:x1875523754159872:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:3.0:1788639422.389938:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+22:18752:x1875523754159872:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 532us (1167us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1788639422.389947:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:0.0:1788639422.390117:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639422.390279:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754160000 00000100:00100000:2.0:1788639422.390285:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754160000 00000100:00100000:2.0:1788639422.390326:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 159 00000100:00100000:2.0:1788639422.390334:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:18100:x1875523754160000:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639422.390468:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:18100:x1875523754160000:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 Request processed in 134us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639422.390474:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 159 00000100:00100000:1.0:1788639422.395917:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639422.396017:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754160128 00000100:00100000:2.0:1788639422.396030:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754160128 00000100:00100000:2.0:1788639422.396102:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 160 00000100:00100000:2.0:1788639422.396114:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+12:18100:x1875523754160128:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639422.396135:0:22796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639422.396161:0:22796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78ba00/0x25c454990262e251 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b7e expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.396200:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78ba00/0x25c454990262e251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b7e expref: 13 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.396213:0:22796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78ba00/0x25c454990262e251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b7e expref: 13 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.396224:0:22796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78ba00, rc 0) 00000100:00100000:2.0:1788639422.396566:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18100:x1875523754160128:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 453us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639422.396591:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 160 00000100:00100000:1.0:1788639422.398918:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639422.399039:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754160256 00000100:00100000:0.0:1788639422.399052:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754160256 00000100:00100000:0.0:1788639422.399119:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 161 00000100:00100000:0.0:1788639422.399136:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18100:x1875523754160256:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639422.399327:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18100:x1875523754160256:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 195us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639422.399344:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 161 00000100:00100000:0.0:1788639422.406041:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639422.406177:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754160384 00000100:00100000:2.0:1788639422.406191:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754160384 00000100:00100000:2.0:1788639422.406270:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 162 00000100:00100000:2.0:1788639422.406282:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18100:x1875523754160384:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639422.406486:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:18100:x1875523754160384:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 Request processed in 205us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639422.406495:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 162 00000100:00100000:1.0:1788639422.612470:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639422.612587:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754160640 00000100:00100000:2.0:1788639422.612601:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754160640 00000100:00100000:2.0:1788639422.612728:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:2.0:1788639422.612740:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+22:18785:x1875523754160640:12345-192.168.206.18@tcp:101:cat.0 00010000:00010000:2.0:1788639422.612771:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639422.612799:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262e258 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b85 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.613028:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23a00/0x25c454990262e25f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.613047:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23a00/0x25c454990262e25f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.613063:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23a00/0x25c454990262e25f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639422.613076:0:22804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788639422.613235:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262e258 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b85 expref: 25 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.613271:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23a00/0x25c454990262e25f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b85 expref: 24 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.613280:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:2.0:1788639422.613284:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639422.613288:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23a00, rc 0) 00000100:00100000:2.0:1788639422.613566:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+24:18785:x1875523754160640:12345-192.168.206.18@tcp:101:cat.0 Request processed in 827us (1110us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788639422.613574:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:1.0:1788639422.623387:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639422.623435:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.623570:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754161024 00000100:00100000:3.0:1788639422.623583:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754161024 00000100:00100000:3.0:1788639422.623699:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:3.0:1788639422.623711:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1e69c21-2788-49fc-9d54-7459329ec792+24:2406:x1875523754161024:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639422.623732:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639422.623776:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23a00/0x25c454990262e25f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b85 expref: 24 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.624041:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:3.0:1788639422.624048:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639422.624133:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f265180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1e69c21-2788-49fc-9d54-7459329ec792+23:2406:x1875523754161024:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 423us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639422.624143:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:2.0:1788639422.624347:0:22806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754160896 00000100:00100000:2.0:1788639422.624363:0:22806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754160896 00000100:00100000:2.0:1788639422.624812:0:22806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:2.0:1788639422.624836:0:22806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e69c21-2788-49fc-9d54-7459329ec792+23:18785:x1875523754160896:12345-192.168.206.18@tcp:35:cat.0 00000100:00100000:2.0:1788639422.625113:0:22806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1e69c21-2788-49fc-9d54-7459329ec792+24:18785:x1875523754160896:12345-192.168.206.18@tcp:35:cat.0 Request processed in 290us (1740us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788639422.625126:0:22806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:1.0:1788639422.686335:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639422.686915:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754161280 00000100:00100000:0.0:1788639422.686926:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754161280 00000100:00100000:0.0:1788639422.686996:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:0.0:1788639422.687007:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+24:18791:x1875523754161280:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:0.0:1788639422.687030:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639422.687050:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e26d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b8c expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.687158:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e274 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.687174:0:22803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262e204 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b5b expref: 25 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.687181:0:22803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b62 expref: 25 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.687201:0:22803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e274 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.687232:0:22803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b62 expref: 25 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.687247:0:22803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b62 expref: 25 pid: 22804 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639422.687261:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22803:1875523773135616:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639422.687356:0:22803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262e204 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b5b expref: 25 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.687365:0:22803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262e204 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b5b expref: 25 pid: 24188 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639422.687374:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a90380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22803:1875523773135744:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639422.687396:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639422.691903:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639422.692395:0:24337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754161408 00000100:00100000:3.0:1788639422.692404:0:24337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754161408 00010000:00010000:3.0:1788639422.692444:0:24337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b62 expref: 26 pid: 22804 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639422.692565:0:24337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:3.0:1788639422.692576:0:24337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1e69c21-2788-49fc-9d54-7459329ec792+26:2407:x1875523754161408:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639422.692591:0:24337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639422.692654:0:24337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b62 expref: 26 pid: 22804 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.692671:0:24337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b62 expref: 26 pid: 22804 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.692693:0:24337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:3.0:1788639422.692699:0:24337:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e274 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.692708:0:24337:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e274 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639422.692716:0:24337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639422.692775:0:24337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1e69c21-2788-49fc-9d54-7459329ec792+26:2407:x1875523754161408:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 200us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639422.692783:0:24337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00010000:00010000:1.0:1788639422.693517:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262e219 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b62 expref: 25 pid: 22804 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639422.693530:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639422.693550:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22803:1875523773135616:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639422.693565:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a90380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22803:1875523773135744:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639422.693587:0:22803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e274 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639422.693802:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754161536 00000100:00100000:0.0:1788639422.693808:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754161536 00010000:00010000:0.0:1788639422.693845:0:22787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262e204 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b5b expref: 25 pid: 24188 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639422.693973:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:0.0:1788639422.693981:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1e69c21-2788-49fc-9d54-7459329ec792+25:2407:x1875523754161536:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639422.694003:0:22787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639422.694009:0:22787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262e204 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b5b expref: 25 pid: 24188 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.694020:0:22787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262e204 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b5b expref: 25 pid: 24188 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.694037:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262e204 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b5b expref: 25 pid: 24188 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.694048:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:0.0:1788639422.694052:0:22787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e274 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.694060:0:22787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e274 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.694066:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e274 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.694087:0:22787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639422.694176:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37dfff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1e69c21-2788-49fc-9d54-7459329ec792+24:2407:x1875523754161536:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 195us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639422.694183:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00010000:00010000:1.0:1788639422.695472:0:22803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e274 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.695485:0:22803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e274 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639422.695505:0:22803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788639422.697347:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e26d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b8c expref: 25 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.697374:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262e274 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b8c expref: 24 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.697383:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:1.0:1788639422.697399:0:22803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788639422.697403:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dca00, rc 0) 00000100:00100000:1.0:1788639422.697517:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+24:18791:x1875523754161280:12345-192.168.206.18@tcp:101:dd.0 Request processed in 10511us (11191us total) trans 12884901905 rc 0/0 00000100:00100000:1.0:1788639422.697525:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:2.0:1788639422.701011:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639422.701425:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754161664 00000100:00100000:1.0:1788639422.701434:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754161664 00000100:00100000:1.0:1788639422.701496:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:1.0:1788639422.701508:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+24:18791:x1875523754161664:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:1.0:1788639422.701530:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639422.701549:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750faa00/0x25c454990262e282 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b93 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.701584:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262e289 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.701599:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262e289 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.701610:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262e289 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.701759:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750faa00/0x25c454990262e282 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b93 expref: 26 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.701783:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262e289 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b93 expref: 25 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.701791:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:1.0:1788639422.701801:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639422.701805:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa000, rc 0) 00000100:00100000:1.0:1788639422.701873:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+25:18791:x1875523754161664:12345-192.168.206.18@tcp:101:dd.0 Request processed in 367us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639422.701880:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:2.0:1788639422.705903:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639422.707253:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754161920 00000100:00100000:1.0:1788639422.707266:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754161920 00000100:00100000:1.0:1788639422.707331:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00100000:1.0:1788639422.707344:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+25:18791:x1875523754161920:12345-192.168.206.18@tcp:36:dd.0 00010000:00010000:1.0:1788639422.707551:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.707569:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.707580:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788639422.707650:0:24188:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:1.0:1788639422.707892:0:24188:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007404e69f reply state 00000000e0e2aa64 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.707907:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639422.707914:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:1.0:1788639422.707917:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788639422.707921:0:24188:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788639422.708179:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+28:18791:x1875523754161920:12345-192.168.206.18@tcp:36:dd.0 Request processed in 837us (2282us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1788639422.708187:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 45 00000020:00080000:0.0:1788639422.708192:0:24188:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788639422.712063:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000040:00080000:3.0:1788639422.712240:0:22838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788639422.712249:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754162048 00000100:00100000:2.0:1788639422.712260:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754162048 00000100:00100000:2.0:1788639422.712316:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:2.0:1788639422.712327:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+28:18791:x1875523754162048:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:2.0:1788639422.712348:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639422.712377:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e297 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85b9a expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.712431:0:22802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e297 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b9a expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.712446:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e297 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b9a expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.712464:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:2.0:1788639422.712467:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788639422.712471:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22400, rc 0) 00000100:00100000:2.0:1788639422.712530:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+29:18791:x1875523754162048:12345-192.168.206.18@tcp:101:dd.0 Request processed in 205us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639422.712537:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 46 00000040:00080000:0.0:1788639422.713914:0:23559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788639422.736586:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639422.736846:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754162304 00000100:00100000:0.0:1788639422.736856:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754162304 00000100:00100000:0.0:1788639422.736918:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:0.0:1788639422.736930:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e69c21-2788-49fc-9d54-7459329ec792+29:18791:x1875523754162304:12345-192.168.206.18@tcp:103:dd.0 00010000:00010000:0.0:1788639422.736944:0:22789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639422.736967:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e297 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b9a expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.736983:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:0.0:1788639422.736988:0:22789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639422.737037:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e69c21-2788-49fc-9d54-7459329ec792+28:18791:x1875523754162304:12345-192.168.206.18@tcp:103:dd.0 Request processed in 111us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639422.737044:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:3.0:1788639422.738766:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639422.739003:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754162432 00000100:00100000:0.0:1788639422.739012:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754162432 00000100:00100000:0.0:1788639422.739070:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:0.0:1788639422.739080:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+28:18791:x1875523754162432:12345-192.168.206.18@tcp:58:dd.0 00010000:00010000:0.0:1788639422.739177:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.739194:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639422.739204:0:22803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788639422.740883:0:22803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788639422.740914:0:22803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788639422.741039:0:22803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788639422.741145:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+28:18791:x1875523754162432:12345-192.168.206.18@tcp:58:dd.0 Request processed in 2062us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639422.741155:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:1.0:1788639422.749091:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639422.749480:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754162560 00000100:00100000:2.0:1788639422.749490:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754162560 00000100:00100000:2.0:1788639422.749858:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 48 00000100:00100000:2.0:1788639422.749870:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+28:18791:x1875523754162560:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:2.0:1788639422.749889:0:22802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639422.749908:0:22802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22a00/0x25c454990262e2a5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85ba1 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.749971:0:22802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.749983:0:22802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22a00/0x25c454990262e2a5 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ba1 expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.750024:0:22802:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.750038:0:22802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22a00/0x25c454990262e2a5 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ba1 expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.750050:0:22802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:2.0:1788639422.750053:0:22802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788639422.750057:0:22802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22a00/0x25c454990262e2a5 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ba1 expref: 29 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639422.750065:0:22802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22a00, rc 0) 00000100:00100000:2.0:1788639422.750127:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+29:18791:x1875523754162560:12345-192.168.206.18@tcp:101:dd.0 Request processed in 260us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639422.750134:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 48 00010000:00010000:3.0:1788639423.349225:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639423.732813:0:22838:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788639423.732830:0:22838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639423.732872:0:22838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788639423.732881:0:22838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788639423.733026:0:22838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22838:1875523773135872:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788639423.733114:0:22838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242fb1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788639423.737758:0:22838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22838:1875523773135872:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788639423.741482:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639423.747220:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754162688 00000100:00100000:2.0:1788639423.747236:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754162688 00000100:00100000:2.0:1788639423.747326:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 49 00000100:00100000:2.0:1788639423.747339:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+29:18792:x1875523754162688:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1788639423.747367:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:2.0:1788639423.747373:0:24188:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788639423.747499:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+29:18792:x1875523754162688:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 163us (6023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639423.747507:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 49 00000100:00100000:1.0:1788639423.756020:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639423.756103:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754162816 00000100:00100000:3.0:1788639423.756113:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754162816 00000100:00100000:3.0:1788639423.756172:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:3.0:1788639423.756182:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+29:18792:x1875523754162816:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788639423.756245:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262e2ac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756267:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262e2ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756278:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262e2ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756340:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756348:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756355:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756374:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2ba lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756397:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756403:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639423.756443:0:22804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788639423.756447:0:22804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639423.756460:0:22804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756470:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262e2ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756477:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262e2ac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756484:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262e2ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756489:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639423.756493:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262e2ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756500:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262e2ac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756510:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae352893b00) 00010000:00010000:3.0:1788639423.756513:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639423.756517:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262e2ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756532:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262e2ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756545:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756550:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2b3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756556:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756561:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639423.756570:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756576:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2b3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756583:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9ae242373200) 00010000:00010000:3.0:1788639423.756585:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639423.756588:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2b3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756593:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756607:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756613:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2ba lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756653:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2ba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756658:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639423.756660:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2ba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756667:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2ba lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756674:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:3.0:1788639423.756677:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639423.756680:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2ba lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.756684:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2ba lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639423.756758:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+29:18792:x1875523754162816:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 Request processed in 577us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639423.756766:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:3.0:1788639423.766784:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639423.769613:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754163072 00000100:00100000:2.0:1788639423.769642:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754163072 00000100:00100000:2.0:1788639423.769725:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:2.0:1788639423.769749:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+29:18792:x1875523754163072:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639423.769769:0:24188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639423.769791:0:24188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23800/0x25c454990262e2c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85ba8 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.769912:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2c8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.769928:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.769940:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639423.769950:0:24188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788639423.770023:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.770031:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2c8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.770038:0:24188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2c8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.770044:0:24188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639423.770048:0:24188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2c8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.770055:0:24188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2c8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.770066:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:2.0:1788639423.770075:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788639423.770080:0:24188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2c8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.770088:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2c8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.770128:0:24188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23800/0x25c454990262e2c1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ba8 expref: 31 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.770138:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae352893b00) 00010000:00010000:2.0:1788639423.770140:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788639423.770143:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23800/0x25c454990262e2c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ba8 expref: 31 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.770152:0:24188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23800, rc 0) 00000100:00100000:2.0:1788639423.770224:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+30:18792:x1875523754163072:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 478us (3449us total) trans 12884901908 rc 301/301 00000100:00100000:2.0:1788639423.770231:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:1.0:1788639423.775090:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639423.775177:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754163200 00000100:00100000:3.0:1788639423.775186:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754163200 00000100:00100000:3.0:1788639423.775242:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:3.0:1788639423.775253:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+30:18792:x1875523754163200:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788639423.775285:0:22804:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788639423.775405:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+30:18792:x1875523754163200:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 154us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639423.775425:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:3.0:1788639423.795853:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639423.796299:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754163456 00000100:00100000:2.0:1788639423.796309:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754163456 00000100:00100000:2.0:1788639423.796378:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:2.0:1788639423.796388:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+30:18792:x1875523754163456:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639423.796407:0:24188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639423.796427:0:24188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23800/0x25c454990262e2d6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85baf expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788639423.796849:0:24188:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =60 00000004:00080000:2.0:1788639423.796862:0:24188:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1788639423.796885:0:24188:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1788639423.797020:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2dd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.797035:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.797046:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.797097:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23800/0x25c454990262e2d6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85baf expref: 33 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.797114:0:24188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2dd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85baf expref: 32 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.797123:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359f00) 00010000:00010000:2.0:1788639423.797126:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639423.797129:0:24188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22400, rc 0) 00000100:00100000:2.0:1788639423.797193:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+32:18792:x1875523754163456:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 807us (1359us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788639423.797200:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:2.0:1788639423.804017:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639423.804103:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754163712 00000100:00100000:3.0:1788639423.804113:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754163712 00000100:00100000:3.0:1788639423.804177:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:3.0:1788639423.804189:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+32:18792:x1875523754163712:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788639423.804243:0:22804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639423.804266:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262e2dd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85baf expref: 32 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804286:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359f00) 00010000:00010000:3.0:1788639423.804298:0:22804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639423.804330:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2eb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804343:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2eb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804352:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2eb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804408:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2f2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3752688c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804417:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2f2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3752688c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804423:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2f2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3752688c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804484:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2eb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804491:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2eb lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804497:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2eb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804503:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639423.804507:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2eb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804514:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2eb lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804522:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ae242359700) 00010000:00010000:3.0:1788639423.804524:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639423.804528:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2eb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804534:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e2eb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804543:0:22804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2f2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3752688c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804549:0:22804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2f2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3752688c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804555:0:22804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2f2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3752688c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804567:0:22804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639423.804570:0:22804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2f2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3752688c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804576:0:22804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2f2 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3752688c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804584:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x3752688c (ffff9ae242373200) 00010000:00010000:3.0:1788639423.804586:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639423.804589:0:22804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2f2 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3752688c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.804595:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e2f2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3752688c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639423.804716:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+31:18792:x1875523754163712:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 528us (708us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788639423.804723:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:3.0:1788639423.809337:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639423.809414:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754163840 00000100:00100000:2.0:1788639423.809423:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754163840 00000100:00100000:2.0:1788639423.809481:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:2.0:1788639423.809491:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+31:18792:x1875523754163840:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639423.809511:0:24188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639423.809547:0:24188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23800/0x25c454990262e2f9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85bb6 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.809584:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262e300 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.809597:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262e300 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.809609:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262e300 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.809750:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23800/0x25c454990262e2f9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bb6 expref: 33 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.809767:0:24188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262e300 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bb6 expref: 32 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.809776:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359100) 00010000:00010000:2.0:1788639423.809778:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788639423.809782:0:24188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22000, rc 0) 00000100:00100000:2.0:1788639423.809857:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+32:18792:x1875523754163840:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 367us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639423.809864:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:1.0:1788639423.812515:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639423.812842:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754164096 00000100:00100000:3.0:1788639423.812851:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754164096 00000100:00100000:3.0:1788639423.812952:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:3.0:1788639423.812963:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+32:18792:x1875523754164096:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788639423.813052:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.813069:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.813098:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639423.813255:0:22804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:3.0:1788639423.813265:0:22804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 682607648405ns, next at 683607645865ns, rc = 0 00000004:00010000:3.0:1788639423.813309:0:22804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000130ec51 reply state 00000000a07e7b87 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.813335:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.813344:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359100) 00010000:00010000:3.0:1788639423.813346:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788639423.813350:0:22804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788639423.813441:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+34:18792:x1875523754164096:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 479us (934us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1788639423.813448:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:2.0:1788639423.821910:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639423.822025:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754164224 00000100:00100000:0.0:1788639423.822034:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754164224 00000100:00100000:0.0:1788639423.822469:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:0.0:1788639423.822479:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+34:18792:x1875523754164224:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639423.822501:0:24188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639423.822520:0:24188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262e30e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85bbd expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.822575:0:24188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262e30e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bbd expref: 35 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.822588:0:24188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262e30e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bbd expref: 35 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.822606:0:24188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359100) 00010000:00010000:0.0:1788639423.822610:0:24188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788639423.823194:0:24188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dd000, rc 0) 00000100:00100000:0.0:1788639423.823245:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+35:18792:x1875523754164224:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 768us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639423.823252:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:1.0:1788639423.832892:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639423.832958:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754164352 00000100:00100000:0.0:1788639423.832968:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754164352 00000100:00100000:0.0:1788639423.833024:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:0.0:1788639423.833033:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e69c21-2788-49fc-9d54-7459329ec792+5:2408:x1875523754164352:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788639423.833251:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e69c21-2788-49fc-9d54-7459329ec792+6:2408:x1875523754164352:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 219us (367us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788639423.833259:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00080000:3.0:1788639423.833316:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639423.843028:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639423.843117:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754164608 00000100:00100000:3.0:1788639423.843127:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754164608 00000100:00100000:3.0:1788639423.843181:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:3.0:1788639423.843191:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+35:18792:x1875523754164608:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788639423.843397:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+36:18792:x1875523754164608:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 206us (376us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788639423.843405:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:2.0:1788639423.847234:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639423.847335:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754164864 00000100:00100000:0.0:1788639423.847356:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754164864 00000100:00100000:0.0:1788639423.847414:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:0.0:1788639423.847424:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+36:18792:x1875523754164864:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788639423.847534:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+36:18792:x1875523754164864:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 112us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639423.847541:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:1.0:1788639423.853073:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639423.853212:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754164992 00000100:00100000:0.0:1788639423.853222:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754164992 00000100:00100000:0.0:1788639423.853344:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:0.0:1788639423.853357:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+36:18792:x1875523754164992:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639423.853376:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639423.853396:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e315 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85bc4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.853462:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e31c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.853476:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e31c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.853488:0:22803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e31c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639423.853536:0:22803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639423.853558:0:22803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e31c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.853582:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e315 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bc4 expref: 38 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.853658:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e31c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bc4 expref: 37 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.853667:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359100) 00010000:00010000:0.0:1788639423.853670:0:22803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788639423.853673:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dda00, rc 0) 00000100:00100000:0.0:1788639423.853773:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+37:18792:x1875523754164992:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 419us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639423.853780:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:1.0:1788639423.859152:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639423.859287:0:24312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754165120 00000100:00100000:2.0:1788639423.859297:0:24312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754165120 00000100:00100000:2.0:1788639423.859342:0:24312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:2.0:1788639423.859351:0:24312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1e69c21-2788-49fc-9d54-7459329ec792+6:2407:x1875523754165120:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639423.859379:0:24312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639423.859400:0:24312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008888c58c/0x25c454990262e323 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85bcb expref: -99 pid: 24312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788639423.859424:0:24312:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c78c0, blocks: 0x0 00010000:00010000:2.0:1788639423.859444:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1788639423.859448:0:24312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639423.859457:0:24312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008888c58c/0x25c454990262e323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bcb expref: 7 pid: 24312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.859476:0:24312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008888c58c/0x25c454990262e323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bcb expref: 7 pid: 24312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.859488:0:24312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22600, rc 0) 00000100:00100000:2.0:1788639423.859547:0:24312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1e69c21-2788-49fc-9d54-7459329ec792+7:2407:x1875523754165120:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 197us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639423.859555:0:24312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:2.0:1788639423.864046:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639423.864991:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754165376 00000100:00100000:0.0:1788639423.865002:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754165376 00000100:00100000:0.0:1788639423.865092:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:0.0:1788639423.865102:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+37:18792:x1875523754165376:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788639423.865198:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+37:18792:x1875523754165376:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 97us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639423.865205:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:3.0:1788639423.882925:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639423.883020:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754165504 00000100:00100000:2.0:1788639423.883030:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754165504 00000100:00100000:2.0:1788639423.883091:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:2.0:1788639423.883101:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+37:18792:x1875523754165504:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788639423.889394:0:22782:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000004:00080000:1.0:1788639423.889408:0:22782:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788639423.889666:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889691:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889699:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889705:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639423.889710:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889718:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889734:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ae242359a00) 00010000:00010000:3.0:1788639423.889737:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639423.889742:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889749:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262e14e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889770:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889776:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889782:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889787:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78bc00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639423.889796:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889804:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889813:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ae242359700) 00010000:00010000:3.0:1788639423.889816:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639423.889831:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889837:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262e155 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788639423.889850:0:22782:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1788639423.889851:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889861:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889867:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889872:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639423.889875:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889881:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889888:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ae242359900) 00010000:00010000:3.0:1788639423.889891:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639423.889899:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889905:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262e1fd lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889921:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889927:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889932:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889937:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fba00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639423.889939:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889944:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.889948:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889953:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:3.0:1788639423.889959:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639423.889960:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889963:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889971:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262e290 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.889983:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.889988:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.889999:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639423.890005:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.890010:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.890014:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.890020:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.890028:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ae242359700) 00010000:00010000:3.0:1788639423.890029:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639423.890035:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.890035:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788639423.890041:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.890046:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.890049:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262e1a2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.890061:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359100) 00010000:00010000:3.0:1788639423.890065:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788639423.890068:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.890075:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e307 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639423.890192:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1e69c21-2788-49fc-9d54-7459329ec792+15:18792:x1875523754165504:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 Request processed in 7089us (7272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639423.890202:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:0.0:1788639423.892172:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773136000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788639423.892238:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639423.892588:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773136000 00000100:00100000:1.0:1788639423.892596:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773136000 00000100:00100000:1.0:1788639423.892854:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788639423.892865:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773136000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788639423.893064:0:24846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788639423.893068:0:24846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788639423.893070:0:24846:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788639423.893072:0:24846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788639424 -> 1788639424 00002000:00010000:1.0:1788639423.893075:0:24846:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788639423.893168:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773136000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 305us (929us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788639423.893175:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:2.0:1788639423.893263:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae375f3a300/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788639423.893269:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773136000:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788639423.895939:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639423.896480:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639423.896855:0:24311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754165632 00000100:00100000:2.0:1788639423.896866:0:24311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754165632 00000100:00100000:2.0:1788639423.896923:0:24311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:2.0:1788639423.896934:0:24311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e69c21-2788-49fc-9d54-7459329ec792+7:2408:x1875523754165632:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788639423.897538:0:24311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e69c21-2788-49fc-9d54-7459329ec792+7:2408:x1875523754165632:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 Request processed in 604us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639423.897554:0:24311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:3.0:1788639423.909708:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639423.909914:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754165888 00000100:00100000:1.0:1788639423.909923:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754165888 00000100:00100000:1.0:1788639423.909978:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:1.0:1788639423.909988:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3748aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+15:18792:x1875523754165888:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788639423.910038:0:22804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639423.910062:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262e31c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bc4 expref: 15 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.910082:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359100) 00010000:00010000:1.0:1788639423.910087:0:22804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639423.910116:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e32a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.910136:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e32a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.910147:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e32a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788639423.910266:0:22804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c555d3c3 reply state 00000000dfa547fa transno 12884901912 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e32a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.910278:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa800/0x25c454990262e32a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.910283:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359100) 00010000:00010000:1.0:1788639423.910286:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788639423.910288:0:22804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788639423.910386:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3748aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+16:18792:x1875523754165888:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 399us (688us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1788639423.910410:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:3.0:1788639423.916932:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639423.917018:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754166016 00000100:00100000:1.0:1788639423.917028:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754166016 00000100:00100000:1.0:1788639423.917083:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:1.0:1788639423.917094:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36ce71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e69c21-2788-49fc-9d54-7459329ec792+7:18792:x1875523754166016:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639423.917111:0:25311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639423.917129:0:25311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85bd2 expref: -99 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.917160:0:25311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008888c58c/0x25c454990262e323 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bcb expref: 8 pid: 24312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.917170:0:25311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639423.917175:0:25311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639423.917181:0:25311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 8 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.917216:0:25311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008888c58c/0x25c454990262e323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bcb expref: 8 pid: 24312 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.917231:0:25311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008888c58c/0x25c454990262e323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bcb expref: 8 pid: 24312 timeout: 782 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639423.917246:0:25311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f264000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25311:1875523773136128:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639423.917329:0:25311:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788639423.923043:0:25311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f264000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25311:1875523773136128:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639423.923082:0:25311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 8 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.923105:0:25311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb600, rc 0) 00000100:00100000:1.0:1788639423.923162:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36ce71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e69c21-2788-49fc-9d54-7459329ec792+8:18792:x1875523754166016:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 6070us (6239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639423.923171:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:3.0:1788639423.928257:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639423.928598:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754166144 00000100:00100000:1.0:1788639423.928609:0:22788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754166144 00010000:00010000:1.0:1788639423.928724:0:22788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008888c58c/0x25c454990262e323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bcb expref: 8 pid: 24312 timeout: 782 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639423.928805:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:1.0:1788639423.928815:0:22788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1e69c21-2788-49fc-9d54-7459329ec792+8:2407:x1875523754166144:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639423.928839:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639423.928863:0:22788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008888c58c/0x25c454990262e323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bcb expref: 8 pid: 24312 timeout: 782 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.928877:0:22788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008888c58c/0x25c454990262e323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bcb expref: 8 pid: 24312 timeout: 782 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.928898:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008888c58c/0x25c454990262e323 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bcb expref: 8 pid: 24312 timeout: 782 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.928927:0:22788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639423.928931:0:22788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639423.928938:0:22788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 7 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.928948:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 7 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.928995:0:22788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 7 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639423.929009:0:22788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f264000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22788:1875523773136256:192.168.206.18@tcp:105: 00000100:00100000:1.0:1788639423.929088:0:22788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788639423.933161:0:22788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f264000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:22788:1875523773136256:192.168.206.18@tcp:105: 00010000:00010000:1.0:1788639423.933185:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639423.933236:0:22788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f1e69c21-2788-49fc-9d54-7459329ec792+7:2407:x1875523754166144:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 4422us (4989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639423.933246:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:3.0:1788639423.933466:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639423.933522:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754166272 00000100:00100000:3.0:1788639423.933529:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754166272 00000100:00100000:3.0:1788639423.933570:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:3.0:1788639423.933579:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e69c21-2788-49fc-9d54-7459329ec792+7:2407:x1875523754166272:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788639423.933769:0:24846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788639423.933773:0:24846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788639423 00002000:00010000:3.0:1788639423.933775:0:24846:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788639422 00002000:00010000:3.0:1788639423.933777:0:24846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788639424 -> 1788639423 00002000:00010000:3.0:1788639423.933779:0:24846:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788639423.933805:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1e69c21-2788-49fc-9d54-7459329ec792+8:2407:x1875523754166272:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 228us (339us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788639423.933811:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:3.0:1788639423.939710:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639423.939911:0:24311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754166400 00000100:00100000:2.0:1788639423.939921:0:24311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754166400 00000100:00100000:2.0:1788639423.939979:0:24311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:2.0:1788639423.939989:0:24311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e69c21-2788-49fc-9d54-7459329ec792+8:2406:x1875523754166400:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788639423.940036:0:24311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.940056:0:24311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 8 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.940065:0:24311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639423.940070:0:24311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639423.940076:0:24311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.940111:0:24311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 8 pid: 25311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.940125:0:24311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 8 pid: 25311 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639423.940141:0:24311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24311:1875523773136384:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639423.940221:0:24311:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae342bb2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788639423.943855:0:24311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24311:1875523773136384:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639423.943887:0:24311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639423.945261:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639423.947786:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754166528 00000100:00100000:0.0:1788639423.947799:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754166528 00010000:00010000:0.0:1788639423.947867:0:22789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 9 pid: 25311 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639423.947913:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:0.0:1788639423.947923:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e69c21-2788-49fc-9d54-7459329ec792+9:2407:x1875523754166528:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639423.947953:0:22789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639423.947975:0:22789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 9 pid: 25311 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.947990:0:22789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 9 pid: 25311 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.948012:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262e331 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd2 expref: 9 pid: 25311 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.948029:0:22789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788639423.948034:0:22789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788639423.948040:0:22789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.948050:0:22789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.948087:0:22789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639423.948150:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e69c21-2788-49fc-9d54-7459329ec792+8:2407:x1875523754166528:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 228us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639423.948158:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00010000:00010000:1.0:1788639423.948378:0:24311:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.948395:0:24311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.948426:0:24311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.948436:0:24311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.948443:0:24311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.948450:0:24311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23a00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639423.948455:0:24311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.948464:0:24311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.948474:0:24311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639423.948480:0:24311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b312683f/0x25c454990262e338 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639423.948542:0:24311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1e69c21-2788-49fc-9d54-7459329ec792+7:2406:x1875523754166400:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 Request processed in 8553us (8840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639423.948550:0:24311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:2.0:1788639423.954601:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639423.954748:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754166784 00000100:00100000:0.0:1788639423.954757:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754166784 00000100:00100000:0.0:1788639423.954829:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:0.0:1788639423.954839:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+16:18792:x1875523754166784:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788639423.954935:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.954953:0:22803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262e289 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b93 expref: 16 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.954963:0:22803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.954992:0:22803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262e289 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b93 expref: 16 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.955006:0:22803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262e289 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b93 expref: 16 pid: 22804 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639423.955020:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22803:1875523773136512:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639423.955093:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639423.961997:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22803:1875523773136512:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639423.962025:0:22803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639423.962902:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639423.963072:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754166912 00000100:00100000:0.0:1788639423.963080:0:22787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754166912 00010000:00010000:0.0:1788639423.963119:0:22787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262e289 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b93 expref: 17 pid: 22804 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639423.963159:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:0.0:1788639423.963168:0:22787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1e69c21-2788-49fc-9d54-7459329ec792+17:2408:x1875523754166912:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639423.963194:0:22787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639423.963201:0:22787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262e289 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b93 expref: 17 pid: 22804 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.963214:0:22787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262e289 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b93 expref: 17 pid: 22804 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.963238:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262e289 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85b93 expref: 17 pid: 22804 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.963256:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:0.0:1788639423.963261:0:22787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22a00/0x25c454990262e2a5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ba1 expref: 16 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.963270:0:22787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.963278:0:22787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.963285:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.963316:0:22787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639423.963373:0:22787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f1e69c21-2788-49fc-9d54-7459329ec792+16:2408:x1875523754166912:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 205us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639423.963380:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00010000:00010000:2.0:1788639423.963679:0:22803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.963686:0:22803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.965101:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.965122:0:22803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262e30e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bbd expref: 16 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.965131:0:22803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.965180:0:22803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262e30e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bbd expref: 16 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.965194:0:22803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262e30e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bbd expref: 16 pid: 24188 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639423.965209:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22803:1875523773136640:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639423.965291:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36f3606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639423.971318:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639423.971495:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754167040 00000100:00100000:2.0:1788639423.971506:0:22789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754167040 00010000:00010000:2.0:1788639423.971546:0:22789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262e30e lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bbd expref: 17 pid: 24188 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639423.971591:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:2.0:1788639423.971613:0:22789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e69c21-2788-49fc-9d54-7459329ec792+17:2408:x1875523754167040:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639423.971670:0:22789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639423.971678:0:22789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262e30e lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bbd expref: 17 pid: 24188 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.971693:0:22789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262e30e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bbd expref: 17 pid: 24188 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.971714:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359100) 00010000:00010000:2.0:1788639423.971719:0:22789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.971727:0:22789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.971734:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.971751:0:22789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639423.971791:0:22789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f1e69c21-2788-49fc-9d54-7459329ec792+17:2408:x1875523754167040:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 179us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639423.971798:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00010000:00010000:0.0:1788639423.973298:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262e30e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bbd expref: 16 pid: 24188 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639423.973399:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22803:1875523773136640:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639423.973467:0:22803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.973477:0:22803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.973484:0:22803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639423.973590:0:22803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1788639423.973925:0:22803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:0.0:1788639423.973961:0:22803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788639423.974034:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22803:1875523773136768:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788639423.974094:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639423.974129:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788639423.974187:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773136768 00000100:00100000:3.0:1788639423.974196:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773136768 00000100:00100000:3.0:1788639423.974242:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788639423.974251:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22803:x1875523773136768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788639423.974342:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22803:x1875523773136768:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639423.974349:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788639423.974428:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22803:1875523773136768:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788639423.974561:0:22803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:0.0:1788639423.974599:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22803:1875523773136896:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788639423.974674:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639423.974689:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788639423.975034:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773136896 00000100:00100000:3.0:1788639423.975040:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773136896 00000100:00100000:3.0:1788639423.975074:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788639423.975081:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22803:x1875523773136896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788639423.975182:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22803:x1875523773136896:12345-0@lo:1000:mdt00_001.0 Request processed in 101us (517us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788639423.975190:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788639423.975304:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22803:1875523773136896:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788639423.975346:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975356:0:22803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975375:0:22803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975382:0:22803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639423.975387:0:22803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975396:0:22803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975421:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359100) 00010000:00010000:0.0:1788639423.975424:0:22803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788639423.975430:0:22803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975436:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262e346 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975462:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975469:0:22803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975475:0:22803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975480:0:22803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639423.975482:0:22803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975498:0:22803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975507:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:0.0:1788639423.975509:0:22803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788639423.975515:0:22803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22a00/0x25c454990262e2a5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ba1 expref: 19 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975526:0:22803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22a00/0x25c454990262e2a5 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ba1 expref: 19 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975535:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22a00/0x25c454990262e2a5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ba1 expref: 19 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.975561:0:22803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22a00/0x25c454990262e2a5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85ba1 expref: 19 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639423.975572:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22803:1875523773137024:192.168.206.18@tcp:105: 00000100:00100000:0.0:1788639423.975710:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34ac94480 going to sleep for 11 seconds 00000100:00100000:1.0:1788639423.982222:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639423.982333:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22803:1875523773137024:192.168.206.18@tcp:105: 00010000:00010000:0.0:1788639423.982364:0:22803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982376:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262e29e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982410:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e34d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982433:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e34d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982445:0:22803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e34d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982455:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e34d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982463:0:22803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e34d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982469:0:22803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e34d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982475:0:22803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dce00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639423.982479:0:22803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e34d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982487:0:22803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e34d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982497:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:0.0:1788639423.982501:0:22803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639423.982505:0:22803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e34d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982511:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dce00/0x25c454990262e34d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982520:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982532:0:22803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982538:0:22803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982543:0:22803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dde00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639423.982545:0:22803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982550:0:22803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982558:0:22803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:0.0:1788639423.982560:0:22803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788639423.982563:0:22803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.982568:0:22803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262e33f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639423.982749:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1e69c21-2788-49fc-9d54-7459329ec792+19:18792:x1875523754166784:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 27910us (28155us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1788639423.982758:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 63 00000020:00080000:0.0:1788639423.982764:0:22803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788639423.982998:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754167168 00000100:00100000:2.0:1788639423.983004:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754167168 00000100:00100000:2.0:1788639423.983048:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:2.0:1788639423.983057:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae367b7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+19:18791:x1875523754167168:12345-192.168.206.18@tcp:49:dd.0 00000100:00100000:2.0:1788639423.983148:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae367b7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+19:18791:x1875523754167168:12345-192.168.206.18@tcp:49:dd.0 Request processed in 92us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639423.983165:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000040:00080000:1.0:1788639423.986424:0:22838:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788639423.986432:0:22838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788639423.986452:0:22838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788639423.986460:0:22838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788639423.987353:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639423.987390:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639423.987507:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754167424 00000100:00100000:2.0:1788639423.987516:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754167424 00000100:00100000:2.0:1788639423.987565:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:2.0:1788639423.987575:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+19:18792:x1875523754167424:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788639423.987845:0:22805:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788639423.988088:0:22805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901918 00010000:00010000:2.0:1788639423.988122:0:22805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262e354 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.988139:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262e354 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.988151:0:22805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262e354 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.988159:0:22805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262e354 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.988166:0:22805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262e354 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.988173:0:22805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262e354 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.988225:0:22805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788639423.988306:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f1e69c21-2788-49fc-9d54-7459329ec792+21:18792:x1875523754167424:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 731us (957us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1788639423.988314:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000020:00080000:2.0:1788639423.988340:0:22805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788639423.988529:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754167552 00000100:00100000:3.0:1788639423.988535:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754167552 00000100:00100000:3.0:1788639423.988580:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 64 00000100:00100000:3.0:1788639423.988589:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+21:18791:x1875523754167552:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:3.0:1788639423.988600:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639423.988613:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e35b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85bd9 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.988686:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e362 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.988695:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e362 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.988705:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e362 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.988787:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262e35b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd9 expref: 23 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.988804:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262e362 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85bd9 expref: 22 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639423.988812:0:22804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ae242359000) 00010000:00010000:3.0:1788639423.988815:0:22804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788639423.988829:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5a00, rc 0) 00000100:00100000:3.0:1788639423.988873:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f1e69c21-2788-49fc-9d54-7459329ec792+22:18791:x1875523754167552:12345-192.168.206.18@tcp:101:dd.0 Request processed in 285us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639423.988880:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 64 00010000:00010000:0.0:1788639423.995043:0:25143:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639423.995057:0:25143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262e354 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.995067:0:25143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639423.995087:0:25143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262e354 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.995097:0:25143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262e354 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.995115:0:25143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ae242359100) 00010000:00010000:0.0:1788639423.995118:0:25143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788639423.995123:0:25143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262e354 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639423.995129:0:25143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262e354 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639423.995214:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639423.995218:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639423.995220:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639424.061057:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639424.061096:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639424.062604:0:24317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754167680 00000100:00100000:1.0:1788639424.062617:0:24317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754167680 00000100:00100000:1.0:1788639424.062777:0:24317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754167808 00000100:00100000:1.0:1788639424.062782:0:24317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754167808 00000100:00100000:2.0:1788639424.063067:0:24318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:2.0:1788639424.063080:0:24318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e69c21-2788-49fc-9d54-7459329ec792+8:2408:x1875523754167680:12345-192.168.206.18@tcp:4:dd.0 00002000:00010000:2.0:1788639424.063125:0:24318:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9c78bf, atime: 0x6a9c78be, ctime: 0x6a9c78bf, blocks: 0x0 00010000:00010000:2.0:1788639424.063134:0:24318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262e369 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639424.063150:0:24318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1788639424.063154:0:24318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639424.063416:0:24318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262e369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639424.063433:0:24318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262e369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788639424.146471:0:25127:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:1.0:1788639424.146494:0:25127:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:0.0:1788639424.146801:0:24318:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1788639424.146806:0:24318:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1788639423 -> 1788639424 00002000:00010000:0.0:1788639424.146809:0:24318:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788639423 -> 1788639424 00002000:00010000:0.0:1788639424.146811:0:24318:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1788639424.146842:0:24318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262e369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639424.146857:0:24318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262e369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639424.146866:0:24318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262e369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639424.146874:0:24318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639424.146879:0:24318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262e369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639424.146910:0:24318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262e369 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639424.146942:0:24318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262e369 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639424.146951:0:24318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c24435ee/0x25c454990262e369 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639424.147063:0:24318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e69c21-2788-49fc-9d54-7459329ec792+6:2408:x1875523754167680:12345-192.168.206.18@tcp:4:dd.0 Request processed in 83981us (86014us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788639424.147078:0:24318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:0.0:1788639424.147111:0:24318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:0.0:1788639424.147123:0:24318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e69c21-2788-49fc-9d54-7459329ec792+5:2407:x1875523754167808:12345-192.168.206.18@tcp:4:dd.0 00002000:00010000:0.0:1788639424.147165:0:24318:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 4194304, mtime: 0x6a9c78c0, atime: 0x6a9c78be, ctime: 0x6a9c78c0, blocks: 0x2000 00010000:00010000:0.0:1788639424.147173:0:24318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e31cab/0x25c454990262e370 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639424.147185:0:24318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=682s v=(0 0) 00010000:00010000:0.0:1788639424.147190:0:24318:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639424.147197:0:24318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e31cab/0x25c454990262e370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639424.147209:0:24318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056e31cab/0x25c454990262e370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639424.180828:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639424.180861:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773137152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639424.180902:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639424.180913:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773137280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639424.180949:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639424.181031:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773137152 00000100:00100000:1.0:1788639424.181042:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773137152 00000100:00100000:2.0:1788639424.181047:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639424.181077:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773137280 00000100:00100000:2.0:1788639424.181081:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773137280 00000100:00100000:1.0:1788639424.181111:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788639424.181123:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773137152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788639424.181161:0:24315:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788639424.181213:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773137152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639424.181228:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788639424.181252:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788639424.181261:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773137280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788639424.181277:0:24315:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29810368 pending 3485696 free 3923513344 avail 3687772160 00000100:00100000:1.0:1788639424.181316:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773137280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639424.181341:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788639424.181506:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773137280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639424.181705:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639424.181715:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773137408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639424.181748:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639424.181793:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773137408 00000100:00100000:2.0:1788639424.181797:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773137408 00000100:00100000:2.0:1788639424.181831:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788639424.181839:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773137408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639424.181851:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29810368 pending 3485696 free 3923513344 avail 3687772160 00000100:00100000:2.0:1788639424.181884:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773137408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639424.181890:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788639424.181915:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1788639424.181921:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae375f3a300, transno 12884901892 00000004:00080000:2.0:1788639424.181932:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1788639424.181954:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773137408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639424.182210:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773137664:0@lo:400:kworker.0 00000100:00100000:2.0:1788639424.182243:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639424.182266:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773138176:0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.182279:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773137792:0@lo:400:kworker.0 00000100:00100000:2.0:1788639424.182293:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639424.182304:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639424.182312:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773138688:0@lo:400:kworker.0 00000100:00080000:1.0:1788639424.182371:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788639424.182377:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639424.182395:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773137536:0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.182648:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773138304:0@lo:400:kworker.0 00000100:00100000:0.0:1788639424.182841:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773138176 00000100:00100000:0.0:1788639424.182847:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773138176 00000100:00100000:0.0:1788639424.182884:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773137792 00000100:00100000:0.0:1788639424.182887:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773137792 00000100:00100000:2.0:1788639424.183075:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639424.183126:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773138688 00000100:00100000:0.0:1788639424.183130:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773138688 00000100:00080000:0.0:1788639424.183153:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639424.183206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639424.183220:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788639424.183229:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773138176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639424.183239:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773138048:0@lo:400:kworker.0 00000100:00100000:2.0:1788639424.183279:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773138176:12345-0@lo:400:kworker.0 Request processed in 51us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639424.183283:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639424.183286:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788639424.183303:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773138560:0@lo:400:kworker.0 00000100:00100000:2.0:1788639424.183343:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788639424.183350:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773137792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639424.183462:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788639424.183471:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773138688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.183692:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639424.183713:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788639424.183721:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773137920:0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.183750:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639424.183774:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773138432:0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.183796:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639424.183812:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773138688:12345-0@lo:400:kworker.0 Request processed in 343us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639424.183830:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788639424.183837:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773137664 00000100:00100000:3.0:1788639424.183841:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773137664 00000100:00100000:0.0:1788639424.183841:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773138304 00000100:00100000:0.0:1788639424.183844:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773138304 00000100:00080000:0.0:1788639424.183860:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639424.183872:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773137920 00000100:00100000:0.0:1788639424.183872:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773138432 00000100:00100000:3.0:1788639424.183875:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773137920 00000100:00100000:0.0:1788639424.183875:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773138432 00000100:00080000:0.0:1788639424.183886:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639424.183888:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788639424.183894:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773137664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639424.183899:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788639424.183903:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773138304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.183930:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773137664:12345-0@lo:400:kworker.0 Request processed in 35us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639424.183931:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773138304:12345-0@lo:400:kworker.0 Request processed in 27us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639424.183937:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788639424.183937:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788639424.183949:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788639424.183949:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788639424.183955:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773137920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639424.183955:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773138432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639424.183980:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773138432:12345-0@lo:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639424.183981:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773137920:12345-0@lo:400:kworker.0 Request processed in 25us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639424.183987:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788639424.183996:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788639424.184003:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773137536 00000100:00100000:3.0:1788639424.184007:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773137536 00000100:00100000:3.0:1788639424.184038:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788639424.184057:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:3641:x1875523773137536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.184102:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a452a6f1-70bc-4918-a445-81111879f6e1+24:3641:x1875523773137536:12345-0@lo:400:kworker.0 Request processed in 47us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639424.184110:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788639424.184170:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773137920:0@lo:400:kworker.0 00010000:00080000:3.0:1788639424.184183:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36f377100 x1875523773138432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639424.184193:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773138432:0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.184203:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773138304:0@lo:400:kworker.0 00010000:00080000:3.0:1788639424.184306:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36f376a00 x1875523773138688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639424.184332:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773138688:0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.184346:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773138176:0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.184357:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773137664:0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.184399:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773138048 00000100:00100000:3.0:1788639424.184403:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773138048 00000100:00100000:3.0:1788639424.184437:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788639424.184443:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773138048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639424.184475:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773138048:12345-0@lo:400:kworker.0 Request processed in 33us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639424.184482:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788639424.184499:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639424.184611:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773137792:12345-0@lo:400:kworker.0 Request processed in 1259us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639424.184649:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788639424.184800:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773137792:0@lo:400:kworker.0 00000100:00100000:1.0:1788639424.190264:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639424.190727:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773138560 00000100:00100000:0.0:1788639424.190739:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773138560 00000100:00080000:2.0:1788639424.191103:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639424.191150:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788639424.191165:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24481b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773138560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639424.191258:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24481b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773138560:12345-0@lo:400:kworker.0 Request processed in 98us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639424.191266:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788639424.191639:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773137152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639424.191806:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a452a6f1-70bc-4918-a445-81111879f6e1:3641:1875523773137536:0@lo:400:kworker.0 00000100:00100000:1.0:1788639424.191834:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773138048:0@lo:400:kworker.0 00000100:00100000:1.0:1788639424.191847:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773138560:0@lo:400:kworker.0 00000001:00080000:1.0:1788639424.208535:0:25127:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1788639424.211049:0:24318:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788639424.211063:0:24318:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788639424.211086:0:24318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e31cab/0x25c454990262e370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639424.211102:0:24318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056e31cab/0x25c454990262e370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639424.211114:0:24318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056e31cab/0x25c454990262e370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639424.211122:0:24318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dde00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639424.211129:0:24318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e31cab/0x25c454990262e370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639424.211139:0:24318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e31cab/0x25c454990262e370 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639424.211166:0:24318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056e31cab/0x25c454990262e370 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639424.211175:0:24318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056e31cab/0x25c454990262e370 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639424.212846:0:24318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1e69c21-2788-49fc-9d54-7459329ec792+5:2407:x1875523754167808:12345-192.168.206.18@tcp:4:dd.0 Request processed in 65699us (151720us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788639424.212865:0:24318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00010000:00010000:3.0:1788639424.372910:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639424.991262:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639424.991311:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639424.991352:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639424.991383:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639424.991411:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754168192 00000100:00100000:2.0:1788639424.991419:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754168192 00000100:00100000:2.0:1788639424.991476:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754168704 00000100:00100000:2.0:1788639424.991480:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754168704 00000100:00100000:2.0:1788639424.991500:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:2.0:1788639424.991508:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+5:2406:x1875523754168192:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639424.991572:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+5:2406:x1875523754168192:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 64us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639424.991579:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:2.0:1788639424.991598:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:2.0:1788639424.991605:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+5:2406:x1875523754168704:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639424.991658:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+5:2406:x1875523754168704:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 53us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639424.991664:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00080000:2.0:1788639424.991680:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639424.991707:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639424.991761:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639424.991776:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754168064 00000100:00100000:2.0:1788639424.991792:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754168064 00000100:00100000:2.0:1788639424.991822:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:2.0:1788639424.991829:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+22:2406:x1875523754168064:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639424.991855:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+22:2406:x1875523754168064:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 27us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639424.991861:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:2.0:1788639424.991896:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639424.991961:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639424.991973:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754168576 00000100:00100000:2.0:1788639424.991976:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754168576 00000100:00100000:2.0:1788639424.991998:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:2.0:1788639424.992004:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+6:2406:x1875523754168576:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639424.992048:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+6:2406:x1875523754168576:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639424.992055:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00080000:2.0:1788639424.992069:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639424.992103:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639424.992434:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754167936 00000100:00100000:0.0:1788639424.992439:0:22796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754167936 00000100:00100000:0.0:1788639424.992476:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 164 00000100:00100000:0.0:1788639424.992483:0:22796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:2406:x1875523754167936:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639424.992515:0:22796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:2406:x1875523754167936:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 33us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639424.992521:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 164 00000100:00100000:0.0:1788639424.992548:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754168448 00000100:00100000:0.0:1788639424.992552:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754168448 00000100:00100000:0.0:1788639424.992572:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754168960 00000100:00100000:0.0:1788639424.992575:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754168960 00000100:00100000:0.0:1788639424.992595:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754168320 00000100:00100000:0.0:1788639424.992598:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754168320 00000100:00100000:0.0:1788639424.992609:0:24313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754168832 00000100:00100000:0.0:1788639424.992611:0:24313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754168832 00000100:00100000:0.0:1788639424.992672:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:0.0:1788639424.992679:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e69c21-2788-49fc-9d54-7459329ec792+5:2406:x1875523754168448:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639424.992703:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e69c21-2788-49fc-9d54-7459329ec792+5:2406:x1875523754168448:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 25us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639424.992721:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:0.0:1788639424.992734:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:0.0:1788639424.992740:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae368d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a83c22d7-5407-4056-8946-d5050573f0a0+5:2406:x1875523754168960:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639424.992765:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae368d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a83c22d7-5407-4056-8946-d5050573f0a0+5:2406:x1875523754168960:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 26us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639424.992771:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:0.0:1788639424.992883:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:0.0:1788639424.992890:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e69c21-2788-49fc-9d54-7459329ec792+5:2406:x1875523754168320:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639424.992912:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f1e69c21-2788-49fc-9d54-7459329ec792+5:2406:x1875523754168320:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 23us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639424.992919:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:0.0:1788639424.992930:0:24313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:0.0:1788639424.992936:0:24313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a83c22d7-5407-4056-8946-d5050573f0a0+5:2406:x1875523754168832:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639424.992958:0:24313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a83c22d7-5407-4056-8946-d5050573f0a0+5:2406:x1875523754168832:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 23us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639424.992963:0:24313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00080000:0.0:1788639424.992977:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639424.992980:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1788639425.012770:0:22838:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788639425.012778:0:22838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788639425.012821:0:22838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788639425.012834:0:22838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788639425.396925:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788639425.519007:0:25888:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1788639426.230170:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773138816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639426.230250:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639426.230336:0:24314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773138816 00000100:00100000:2.0:1788639426.230345:0:24314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773138816 00000100:00100000:2.0:1788639426.230412:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788639426.230422:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773138816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639426.230451:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788639426.230499:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773138816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639426.230506:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788639426.230591:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773138816:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788639426.230834:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788639426.420958:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639426.741553:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639426.741575:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24481a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773138944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639426.741701:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639426.741799:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773138944 00000100:00100000:1.0:1788639426.741817:0:22807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773138944 00000100:00100000:1.0:1788639426.741880:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788639426.741890:0:22807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773138944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639426.741923:0:22807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788639426.741969:0:22807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773138944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639426.741976:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788639426.742073:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24481a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773138944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639426.742731:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773139072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639426.742766:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639426.743091:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773139072 00000100:00100000:0.0:1788639426.743098:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773139072 00000100:00100000:0.0:1788639426.743140:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788639426.743148:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773139072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788639426.743174:0:22808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788639426.743226:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773139072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639426.743232:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788639426.744023:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773139072:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788639427.448087:0:22791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788639427.829289:0:23559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788639428.469573:0:22790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639429.300817:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773139328:0@lo:400:kworker.0 00000100:00100000:1.0:1788639429.300827:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773139712:0@lo:400:kworker.0 00000100:00100000:1.0:1788639429.300899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639429.300905:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639429.300941:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773139328 00000100:00100000:3.0:1788639429.300949:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773139328 00000100:00100000:2.0:1788639429.300957:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773139584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639429.300967:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773140224:0@lo:400:kworker.0 00000100:00100000:2.0:1788639429.300990:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639429.301001:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788639429.301006:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639429.301014:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773139200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639429.301016:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+24:3642:x1875523773139328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639429.301034:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773140736:0@lo:400:kworker.0 00000100:00100000:2.0:1788639429.301044:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639429.301066:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24481b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773139456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639429.301074:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639429.301099:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639429.301102:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788639429.301111:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773139840:0@lo:400:kworker.0 00000100:00100000:2.0:1788639429.301126:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773140096:0@lo:400:kworker.0 00000100:00100000:1.0:1788639429.301140:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639429.301156:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639429.301166:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773140352:0@lo:400:kworker.0 00000100:00100000:2.0:1788639429.301180:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773140608:0@lo:400:kworker.0 00000100:00100000:1.0:1788639429.301195:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639429.301221:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639429.301235:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773140864:0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.301243:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a452a6f1-70bc-4918-a445-81111879f6e1+24:3642:x1875523773139328:12345-0@lo:400:kworker.0 Request processed in 229us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.301253:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788639429.301261:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f2bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773141120:0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.301292:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773139584 00000100:00100000:3.0:1788639429.301297:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773139584 00000100:00100000:3.0:1788639429.301323:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773139200 00000100:00100000:3.0:1788639429.301327:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773139200 00000100:00100000:3.0:1788639429.301338:0:24315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773139456 00000100:00100000:3.0:1788639429.301340:0:24315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773139456 00000100:00100000:3.0:1788639429.301354:0:24315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788639429.301359:0:24315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773139584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788639429.301380:0:24315:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788639429.301442:0:23543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773139712 00000100:00100000:0.0:1788639429.301448:0:23543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773139712 00000100:00100000:0.0:1788639429.301475:0:23543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773140224 00000100:00100000:0.0:1788639429.301478:0:23543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773140224 00000100:00100000:0.0:1788639429.301493:0:23543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788639429.301500:0:23543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773139712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639429.302414:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639429.302632:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a452a6f1-70bc-4918-a445-81111879f6e1:3642:1875523773139328:0@lo:400:kworker.0 00000100:00100000:2.0:1788639429.302654:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788639429.302661:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773139968:0@lo:400:kworker.0 00000100:00100000:2.0:1788639429.302688:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639429.302763:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773140480:0@lo:400:kworker.0 00000100:00100000:2.0:1788639429.302784:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639429.302827:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523773140992:0@lo:400:kworker.0 00000100:00100000:2.0:1788639429.302849:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639429.302881:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788639429.302891:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773139200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639429.302908:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788639429.302943:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773139200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639429.302949:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788639429.302967:0:24314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788639429.302974:0:24314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773139456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639429.302989:0:24314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788639429.303013:0:24314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773139456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639429.303019:0:24314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788639429.303036:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773140736 00000100:00100000:2.0:1788639429.303040:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773140736 00000100:00100000:2.0:1788639429.303064:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773140096 00000100:00100000:2.0:1788639429.303066:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773140096 00000100:00100000:2.0:1788639429.303076:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773140608 00000100:00100000:2.0:1788639429.303078:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773140608 00000100:00100000:2.0:1788639429.303087:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773141120 00000100:00100000:2.0:1788639429.303089:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773141120 00000100:00100000:2.0:1788639429.303098:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773140992 00000100:00100000:2.0:1788639429.303100:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773140992 00000100:00100000:2.0:1788639429.303111:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788639429.303116:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773140736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.303975:0:24315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773139584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2611us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.303986:0:24315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788639429.304028:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788639429.304037:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773140096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304074:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773140096:12345-0@lo:400:kworker.0 Request processed in 40us (2919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.304172:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788639429.304189:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788639429.304195:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773140608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304240:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773140608:12345-0@lo:400:kworker.0 Request processed in 46us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.304247:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788639429.304259:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788639429.304265:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773141120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304293:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773141120:12345-0@lo:400:kworker.0 Request processed in 29us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.304298:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788639429.304310:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788639429.304316:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523773140992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304342:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523773140992:12345-0@lo:400:kworker.0 Request processed in 26us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.304347:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788639429.304386:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773139840 00000100:00100000:3.0:1788639429.304392:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773139840 00000100:00100000:3.0:1788639429.304417:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773140352 00000100:00100000:3.0:1788639429.304420:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773140352 00000100:00100000:3.0:1788639429.304433:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773139968 00000100:00100000:3.0:1788639429.304436:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773139968 00000100:00100000:3.0:1788639429.304444:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773140480 00000100:00100000:3.0:1788639429.304446:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773140480 00000100:00100000:3.0:1788639429.304456:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788639429.304461:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773139840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304498:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773139840:12345-0@lo:400:kworker.0 Request processed in 37us (3358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.304504:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788639429.304516:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788639429.304521:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773140352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304545:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773140352:12345-0@lo:400:kworker.0 Request processed in 24us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.304550:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788639429.304560:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788639429.304566:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773139968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304591:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773139968:12345-0@lo:400:kworker.0 Request processed in 26us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.304595:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788639429.304604:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788639429.304608:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773140480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304655:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773140480:12345-0@lo:400:kworker.0 Request processed in 46us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.304662:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788639429.304709:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773139968:0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304720:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773140480:0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304728:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523773140992:0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304739:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773140096:0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304748:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773140608:0@lo:400:kworker.0 00010000:00080000:3.0:1788639429.304770:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36f2bb480 x1875523773141120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639429.304781:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f2bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773141120:0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.304811:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773139584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639429.304826:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773139200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639429.304841:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24481b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773139456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639429.305054:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788639429.305063:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773140224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.305172:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773140224:12345-0@lo:400:kworker.0 Request processed in 110us (4169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.305179:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788639429.305260:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639429.305265:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639429.305267:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788639429.305269:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639429.305426:0:23543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773139712:12345-0@lo:400:kworker.0 Request processed in 3925us (4528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639429.305435:0:23543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788639429.306561:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773140736:12345-0@lo:400:kworker.0 Request processed in 3439us (5486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639429.306586:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788639429.306902:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639429.306960:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773140224:0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.306985:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773140864 00000100:00100000:1.0:1788639429.306991:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773140736:0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.306994:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773140864 00000100:00100000:1.0:1788639429.307006:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773139712:0@lo:400:kworker.0 00000100:00100000:1.0:1788639429.307033:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773139840:0@lo:400:kworker.0 00000100:00100000:1.0:1788639429.307047:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773140352:0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.307069:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788639429.307091:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24481ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773140864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639429.307155:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24481ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773140864:12345-0@lo:400:kworker.0 Request processed in 77us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639429.307162:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788639429.307240:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788639429.307493:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36f374a80 x1875523773140864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639429.307504:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36f374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773140864:0@lo:400:kworker.0 00010000:00010000:2.0:1788639429.492771:0:25143:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639430.112963:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639430.113007:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639430.113039:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639430.113076:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639430.113097:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639430.113114:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639430.113130:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639430.113147:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639430.113169:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639430.113194:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754169600 00000100:00100000:3.0:1788639430.113202:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754169600 00000100:00100000:3.0:1788639430.113248:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754170112 00000100:00100000:3.0:1788639430.113252:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754170112 00000100:00100000:3.0:1788639430.113266:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754169472 00000100:00100000:3.0:1788639430.113269:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754169472 00000100:00100000:3.0:1788639430.113280:0:25311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754169984 00000100:00100000:3.0:1788639430.113283:0:25311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754169984 00000100:00100000:3.0:1788639430.113311:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:3.0:1788639430.113322:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e69c21-2788-49fc-9d54-7459329ec792+5:2408:x1875523754169600:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639430.113386:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f2b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e69c21-2788-49fc-9d54-7459329ec792+5:2408:x1875523754169600:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 66us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639430.113394:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:3.0:1788639430.113410:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:3.0:1788639430.113416:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a83c22d7-5407-4056-8946-d5050573f0a0+5:2408:x1875523754170112:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639430.113440:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a83c22d7-5407-4056-8946-d5050573f0a0+5:2408:x1875523754170112:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639430.113446:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:3.0:1788639430.113456:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:3.0:1788639430.113462:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e69c21-2788-49fc-9d54-7459329ec792+5:2408:x1875523754169472:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639430.113482:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f1e69c21-2788-49fc-9d54-7459329ec792+5:2408:x1875523754169472:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 21us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639430.113496:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:3.0:1788639430.113508:0:25311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:3.0:1788639430.113515:0:25311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a83c22d7-5407-4056-8946-d5050573f0a0+5:2408:x1875523754169984:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639430.113540:0:25311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a83c22d7-5407-4056-8946-d5050573f0a0+5:2408:x1875523754169984:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 25us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639430.113546:0:25311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:3.0:1788639430.113563:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754169344 00000100:00100000:3.0:1788639430.113566:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754169344 00000100:00100000:3.0:1788639430.113587:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754169856 00000100:00100000:3.0:1788639430.113590:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754169856 00000100:00100000:3.0:1788639430.113602:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754169216 00000100:00100000:3.0:1788639430.113605:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754169216 00000100:00100000:3.0:1788639430.113643:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754169728 00000100:00100000:3.0:1788639430.113647:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754169728 00000100:00100000:3.0:1788639430.113661:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:3.0:1788639430.113667:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+5:2408:x1875523754169344:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639430.113705:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+5:2408:x1875523754169344:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 37us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639430.113712:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:3.0:1788639430.113724:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:3.0:1788639430.113731:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+5:2408:x1875523754169856:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639430.113754:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+5:2408:x1875523754169856:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 23us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639430.113760:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:3.0:1788639430.113771:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:3.0:1788639430.113792:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+22:2408:x1875523754169216:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639430.113832:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f1e69c21-2788-49fc-9d54-7459329ec792+22:2408:x1875523754169216:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 49us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639430.113839:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:3.0:1788639430.113856:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:3.0:1788639430.113864:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36f2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+6:2408:x1875523754169728:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639430.113887:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36f2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a83c22d7-5407-4056-8946-d5050573f0a0+6:2408:x1875523754169728:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 24us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639430.113893:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:0.0:1788639430.114008:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754169088 00000100:00100000:0.0:1788639430.114014:0:22795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754169088 00000100:00100000:0.0:1788639430.114052:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 166 00000100:00100000:0.0:1788639430.114074:0:22795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:2408:x1875523754169088:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639430.114099:0:22795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:71b2c8b8-7aad-41b4-9260-49d0bb897037+13:2408:x1875523754169088:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 40us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639430.114115:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 166 00000100:00080000:0.0:1788639430.114142:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639430.114146:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788639430.114148:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639430.114150:0:22798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 Debug log: 13772 lines, 13772 kept, 0 dropped, 0 bad.