00000040:00080000:0.0F:1790711795.420028:0:17811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0F:1790711795.482842:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711795.548047:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879753088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790711795.548118:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1790711795.548224:0:18075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879753088 00000100:00100000:1.0:1790711795.548243:0:18075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879753088 00000100:00100000:1.0:1790711795.548296:0:18075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790711795.548304:0:18075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879753088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790711795.548349:0:18075:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790711795.548401:0:18075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879753088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711795.548408:0:18075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790711795.548451:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879753088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790711795.550654:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790711795.550676:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879753216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790711795.550742:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711795.551421:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879753216 00000100:00100000:1.0:1790711795.551434:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879753216 00000100:00100000:1.0:1790711795.551492:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790711795.551501:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879753216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790711795.551565:0:17064:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1790711795.551628:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879753216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711795.551635:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790711795.552006:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879753216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0F:1790711796.359065:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711796.359148:0:18567:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867088640 00000100:00100000:0.0:1790711796.359158:0:18567:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867088640 00000100:00100000:0.0:1790711796.359231:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 32 00000100:00100000:0.0:1790711796.359240:0:18567:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd8dab27-e45a-4078-a622-860b4e154abb+5:2406:x1877696867088640:12345-192.168.203.6@tcp:9:kworker.0 00000020:00000080:0.0:1790711796.359269:0:18567:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0614 00000100:00080000:0.0:1790711796.359285:0:18567:0:(import.c:65:import_set_state_nolock()) ffff9dab82cf1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790711796.359325:0:18567:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:2.0:1790711796.359362:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790711796.359516:0:18567:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd8dab27-e45a-4078-a622-860b4e154abb+2:2406:x1877696867088640:12345-192.168.203.6@tcp:9:kworker.0 Request processed in 276us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711796.359525:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 32 00010000:00010000:0.0:1790711796.359617:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711796.365459:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711796.365509:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711796.365572:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711796.365597:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711796.365617:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711796.365636:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711796.365653:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711796.365676:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711796.365715:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867088512 00000100:00100000:0.0:1790711796.365726:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867088512 00000100:00100000:0.0:1790711796.365783:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867088384 00000100:00100000:0.0:1790711796.365786:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867088384 00000100:00100000:0.0:1790711796.365802:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867089024 00000100:00100000:0.0:1790711796.365805:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867089024 00000100:00100000:0.0:1790711796.365816:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867088896 00000100:00100000:0.0:1790711796.365818:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867088896 00000100:00100000:0.0:1790711796.365848:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 83 00000100:00100000:0.0:1790711796.365863:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd8dab27-e45a-4078-a622-860b4e154abb+5:2408:x1877696867088512:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1790711796.365943:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd8dab27-e45a-4078-a622-860b4e154abb+5:2408:x1877696867088512:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 87us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711796.365951:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 83 00000100:00100000:0.0:1790711796.365971:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 84 00000100:00100000:0.0:1790711796.365977:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd8dab27-e45a-4078-a622-860b4e154abb+22:2408:x1877696867088384:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1790711796.366003:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd8dab27-e45a-4078-a622-860b4e154abb+22:2408:x1877696867088384:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711796.366009:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 84 00000100:00100000:0.0:1790711796.366022:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 85 00000100:00100000:0.0:1790711796.366028:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9daca0125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dcc816c-d0f0-4a8d-9916-06e09abe652f+5:2407:x1877696867089024:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1790711796.366052:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9daca0125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dcc816c-d0f0-4a8d-9916-06e09abe652f+5:2407:x1877696867089024:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711796.366058:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 85 00000100:00100000:0.0:1790711796.366069:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 86 00000100:00100000:0.0:1790711796.366074:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dcc816c-d0f0-4a8d-9916-06e09abe652f+6:2407:x1877696867088896:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1790711796.366095:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dcc816c-d0f0-4a8d-9916-06e09abe652f+6:2407:x1877696867088896:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 21us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711796.366100:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 86 00000100:00100000:0.0:1790711796.366120:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867088768 00000100:00100000:0.0:1790711796.366123:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867088768 00000100:00100000:0.0:1790711796.366149:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867089152 00000100:00100000:0.0:1790711796.366152:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867089152 00000100:00100000:0.0:1790711796.366167:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867089280 00000100:00100000:0.0:1790711796.366176:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867089280 00000100:00100000:0.0:1790711796.366195:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 38 00000100:00100000:0.0:1790711796.366200:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd8dab27-e45a-4078-a622-860b4e154abb+5:2407:x1877696867088768:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1790711796.366227:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd8dab27-e45a-4078-a622-860b4e154abb+5:2407:x1877696867088768:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711796.366233:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 38 00000100:00100000:0.0:1790711796.366244:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 33 00000100:00100000:0.0:1790711796.366250:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8dcc816c-d0f0-4a8d-9916-06e09abe652f+5:2406:x1877696867089152:12345-192.168.203.6@tcp:9:kworker.0 00000020:00000080:0.0:1790711796.366273:0:19653:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0653 00000100:00080000:0.0:1790711796.366282:0:19653:0:(import.c:65:import_set_state_nolock()) ffff9dacbc46d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790711796.366324:0:19653:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1790711796.366438:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8dcc816c-d0f0-4a8d-9916-06e09abe652f+2:2406:x1877696867089152:12345-192.168.203.6@tcp:9:kworker.0 Request processed in 187us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711796.366445:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 33 00000100:00100000:0.0:1790711796.366457:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 34 00000100:00100000:0.0:1790711796.366463:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8dcc816c-d0f0-4a8d-9916-06e09abe652f+5:2406:x1877696867089280:12345-192.168.203.6@tcp:9:kworker.0 00000020:00000080:0.0:1790711796.366473:0:19653:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e065a 00000100:00080000:0.0:1790711796.366480:0:19653:0:(import.c:65:import_set_state_nolock()) ffff9dacae5cd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790711796.366503:0:19653:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1790711796.366609:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8dcc816c-d0f0-4a8d-9916-06e09abe652f+2:2406:x1877696867089280:12345-192.168.203.6@tcp:9:kworker.0 Request processed in 145us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711796.366616:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 34 00010000:00010000:0.0:1790711796.366646:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711796.366651:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790711796.368067:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790711796.368074:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790711796.368086:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790711796.368089:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790711796.368846:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867088256 00000100:00100000:1.0:1790711796.368857:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867088256 00000100:00100000:1.0:1790711796.368907:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 173 00000100:00100000:1.0:1790711796.368916:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c36a011-7992-43aa-a826-3c761edae35d+13:2408:x1877696867088256:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1790711796.368991:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c36a011-7992-43aa-a826-3c761edae35d+13:2408:x1877696867088256:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 76us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711796.368998:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 173 00010000:00010000:0.0:1790711796.508656:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790711797.093709:0:17038:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1790711797.093741:0:17038:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9dacba9850c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1790711797.093749:0:17038:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dac8935ba00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9dacba9853c0 00000020:00080000:3.0:1790711797.093754:0:17038:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9dac8935b000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9dab82e4e800 00010000:00010000:0.0:1790711797.093755:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d12800/0xcf3cf816241e08e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711797.093774:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d12800/0xcf3cf816241e08e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711797.093783:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d12800/0xcf3cf816241e08e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711797.093790:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d12800 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:0.0:1790711797.093795:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d12800/0xcf3cf816241e08e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711797.093803:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d12800/0xcf3cf816241e08e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711797.093821:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dacafd1f900) 00010000:00010000:0.0:1790711797.093825:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790711797.093830:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d12800/0xcf3cf816241e08e5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711797.093837:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d12800/0xcf3cf816241e08e5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790711797.094222:0:17097:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1790711797.094303:0:17097:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1790711797.530952:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711798.110039:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879753344:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110116:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110178:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dac8fd48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1877696879753856:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110217:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110238:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879754368:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110258:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110274:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879754880:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110293:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110328:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1790711798.110334:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dac8fd49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879753728:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110357:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110376:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879754240:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110394:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110408:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879754752:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110426:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110456:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dac8fd49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879753472:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110481:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110501:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879753984:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110520:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110570:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1877696879754496:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110591:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110604:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1790711798.110609:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dac8fd48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879753600:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110630:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110648:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879754112:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110669:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110687:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879754624:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110717:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.110747:0:17052:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879753344 00000100:00100000:0.0:1790711798.110754:0:17052:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879753344 00000100:00100000:0.0:1790711798.110812:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1790711798.110821:0:17052:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1803113-c9d6-45cb-a2b6-061f96b8256e+24:3608:x1877696879753344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.110873:0:17052:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1803113-c9d6-45cb-a2b6-061f96b8256e+24:3608:x1877696879753344:12345-0@lo:400:kworker.0 Request processed in 54us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.110881:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1790711798.110913:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879753856 00000100:00100000:0.0:1790711798.110917:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879753856 00000100:00100000:0.0:1790711798.110938:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879754368 00000100:00100000:0.0:1790711798.110941:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879754368 00000100:00100000:0.0:1790711798.110950:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879754880 00000100:00100000:0.0:1790711798.110952:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879754880 00000100:00100000:0.0:1790711798.110973:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879754752 00000100:00100000:0.0:1790711798.110976:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879754752 00000100:00100000:0.0:1790711798.110987:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879754496 00000100:00100000:0.0:1790711798.110989:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879754496 00000100:00100000:0.0:1790711798.110999:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879754624 00000100:00100000:0.0:1790711798.111001:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879754624 00000100:00100000:0.0:1790711798.111014:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790711798.111019:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1877696879753856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111054:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1877696879753856:12345-0@lo:400:kworker.0 Request processed in 34us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111061:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790711798.111073:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790711798.111079:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879754368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111104:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879754368:12345-0@lo:400:kworker.0 Request processed in 26us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111115:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790711798.111126:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790711798.111131:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1877696879754880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111155:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1877696879754880:12345-0@lo:400:kworker.0 Request processed in 24us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111160:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790711798.111168:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790711798.111172:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1877696879754752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111191:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1877696879754752:12345-0@lo:400:kworker.0 Request processed in 19us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111196:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790711798.111205:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790711798.111209:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1877696879754496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111234:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1877696879754496:12345-0@lo:400:kworker.0 Request processed in 25us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111240:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790711798.111249:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790711798.111254:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1877696879754624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111277:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1877696879754624:12345-0@lo:400:kworker.0 Request processed in 23us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111282:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790711798.111303:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879753728 00000100:00100000:0.0:1790711798.111306:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879753728 00000100:00100000:0.0:1790711798.111337:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879754240 00000100:00100000:0.0:1790711798.111340:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879754240 00000100:00100000:0.0:1790711798.111361:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879753600 00000100:00100000:0.0:1790711798.111365:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879753600 00000100:00100000:0.0:1790711798.111375:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879754112 00000100:00100000:0.0:1790711798.111377:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879754112 00000100:00100000:0.0:1790711798.111386:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790711798.111391:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879753728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111423:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879753728:12345-0@lo:400:kworker.0 Request processed in 31us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111429:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790711798.111440:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790711798.111445:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879754240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111470:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879754240:12345-0@lo:400:kworker.0 Request processed in 25us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111476:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790711798.111485:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790711798.111491:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879753600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111519:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879753600:12345-0@lo:400:kworker.0 Request processed in 28us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111524:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790711798.111534:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790711798.111569:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879754112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111595:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879754112:12345-0@lo:400:kworker.0 Request processed in 56us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111601:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790711798.111623:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879753472 00000100:00100000:0.0:1790711798.111626:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879753472 00000100:00100000:0.0:1790711798.111644:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879753984 00000100:00100000:0.0:1790711798.111652:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879753984 00000100:00100000:0.0:1790711798.111664:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790711798.111668:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879753472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111699:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879753472:12345-0@lo:400:kworker.0 Request processed in 31us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111705:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790711798.111715:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790711798.111720:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879753984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111741:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879753984:12345-0@lo:400:kworker.0 Request processed in 21us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.111746:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1790711798.111769:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790711798.111773:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790711798.111775:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790711798.111777:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790711798.111821:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dac8fd48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879753600:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111831:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879754112:0@lo:400:kworker.0 00010000:00080000:0.0:1790711798.111843:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dacb51b4380 x1877696879754624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711798.111854:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879754624:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111862:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dac8fd49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879753472:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111870:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879753984:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111878:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1877696879754496:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111907:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dac8fd49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879753728:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111922:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879754240:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111931:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879754752:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111939:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879753344:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111947:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dac8fd48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1877696879753856:0@lo:400:kworker.0 00000100:00100000:0.0:1790711798.111955:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879754368:0@lo:400:kworker.0 00010000:00080000:0.0:1790711798.111964:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dacb51b7800 x1877696879754880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711798.111972:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879754880:0@lo:400:kworker.0 00000100:00100000:3.0:1790711798.112951:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790711798.112968:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879755008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790711798.113019:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711798.113062:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879755008 00000100:00100000:3.0:1790711798.113067:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879755008 00000100:00100000:3.0:1790711798.113243:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790711798.113254:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879755008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790711798.113280:0:18568:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790711798.113334:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879755008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711798.113340:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790711798.113389:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879755008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790711798.113512:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711798.114046:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867089408 00000100:00100000:3.0:1790711798.114052:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867089408 00000100:00100000:3.0:1790711798.114103:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00100000:3.0:1790711798.114111:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd8dab27-e45a-4078-a622-860b4e154abb+13:15581:x1877696867089408:12345-192.168.203.6@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790711798.114309:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd8dab27-e45a-4078-a622-860b4e154abb+13:15581:x1877696867089408:12345-192.168.203.6@tcp:60:lhsmtool_posix.0 Request processed in 198us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711798.114317:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00080000:1.0:1790711798.114374:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790711798.118160:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711798.118201:0:19887:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867089536 00000100:00100000:2.0:1790711798.118211:0:19887:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867089536 00000100:00100000:2.0:1790711798.118268:0:19887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00100000:2.0:1790711798.118277:0:19887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd8dab27-e45a-4078-a622-860b4e154abb+5:15581:x1877696867089536:12345-192.168.203.6@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790711798.118399:0:19887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd8dab27-e45a-4078-a622-860b4e154abb+5:15581:x1877696867089536:12345-192.168.203.6@tcp:60:lhsmtool_posix.0 Request processed in 121us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711798.118406:0:19887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00080000:2.0:1790711798.118431:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790711798.118721:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790711798.118738:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879755136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790711798.118784:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711798.125367:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711798.125589:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867089792 00000100:00100000:1.0:1790711798.125599:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867089792 00000100:00100000:1.0:1790711798.125650:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:1.0:1790711798.125673:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd8dab27-e45a-4078-a622-860b4e154abb+13:15581:x1877696867089792:12345-192.168.203.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790711798.125921:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd8dab27-e45a-4078-a622-860b4e154abb+14:15581:x1877696867089792:12345-192.168.203.6@tcp:35:lhsmtool_posix.0 Request processed in 249us (563us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1790711798.125930:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:0.0:1790711798.127720:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879755136 00000100:00100000:0.0:1790711798.127733:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879755136 00000100:00100000:0.0:1790711798.127793:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790711798.127804:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879755136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790711798.127847:0:18568:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790711798.127919:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879755136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (9134us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711798.127926:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790711798.127979:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879755136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790711798.554789:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711798.619162:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879755264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790711798.619245:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711798.621648:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879755264 00000100:00100000:3.0:1790711798.621664:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879755264 00000100:00100000:3.0:1790711798.624354:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790711798.624366:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879755264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790711798.624402:0:18568:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790711798.624506:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879755264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (5272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711798.624514:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790711798.624605:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879755264:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1790711799.323133:0:17092:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790711799.323144:0:17092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790711799.323167:0:17092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790711799.323173:0:17092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1790711799.579354:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711799.644023:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790711799.644047:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879755392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790711799.644119:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711799.644160:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879755392 00000100:00100000:2.0:1790711799.644167:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879755392 00000100:00100000:2.0:1790711799.644212:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790711799.644220:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879755392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790711799.644255:0:18569:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790711799.644326:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879755392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711799.644333:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790711799.644378:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879755392:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1790711800.518326:0:20435:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 15:56:37 (1790711797) 00010000:00010000:0.0:1790711800.604194:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711800.669766:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790711800.669789:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879755520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790711800.669851:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711800.670052:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879755520 00000100:00100000:0.0:1790711800.670068:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879755520 00000100:00100000:0.0:1790711800.670146:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790711800.670157:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879755520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790711800.670203:0:17063:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1790711800.671210:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879755520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1051us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711800.671233:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790711800.671319:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879755648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790711800.671366:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711800.671438:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879755648 00000100:00100000:0.0:1790711800.671445:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879755648 00000100:00100000:0.0:1790711800.671483:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790711800.671491:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879755648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790711800.671527:0:17064:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790711800.672196:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879755520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790711800.672332:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879755648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 841us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711800.672342:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790711800.672412:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879755648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790711801.473380:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711801.473451:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711801.473501:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867090048 00000100:00100000:1.0:1790711801.473517:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867090048 00000100:00100000:1.0:1790711801.473624:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 93 00000100:00100000:1.0:1790711801.473638:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd8dab27-e45a-4078-a622-860b4e154abb+14:2410:x1877696867090048:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:2.0:1790711801.473639:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790711801.473757:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd8dab27-e45a-4078-a622-860b4e154abb+14:2410:x1877696867090048:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 122us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711801.473766:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 93 00000100:00100000:3.0:1790711801.473977:0:17050:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867089920 00000100:00100000:3.0:1790711801.473984:0:17050:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867089920 00000100:00100000:3.0:1790711801.474026:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 175 00000100:00100000:3.0:1790711801.474035:0:17050:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c36a011-7992-43aa-a826-3c761edae35d+13:2410:x1877696867089920:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1790711801.474070:0:17050:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c36a011-7992-43aa-a826-3c761edae35d+13:2410:x1877696867089920:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 37us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711801.474077:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 175 00000100:00100000:1.0:1790711801.481920:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711801.481977:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711801.482026:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867090304 00000100:00100000:0.0:1790711801.482054:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867090304 00000100:00100000:0.0:1790711801.482141:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00100000:3.0:1790711801.482145:0:19887:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867090560 00000100:00100000:3.0:1790711801.482152:0:19887:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867090560 00000100:00100000:0.0:1790711801.482155:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd8dab27-e45a-4078-a622-860b4e154abb+5:2409:x1877696867090304:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1790711801.482208:0:19887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 94 00000100:00100000:3.0:1790711801.482218:0:19887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8dcc816c-d0f0-4a8d-9916-06e09abe652f+5:2409:x1877696867090560:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1790711801.482282:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711801.482314:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd8dab27-e45a-4078-a622-860b4e154abb+5:2409:x1877696867090304:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 161us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711801.482328:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00080000:0.0:1790711801.482360:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790711801.482372:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790711801.485437:0:19887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8dcc816c-d0f0-4a8d-9916-06e09abe652f+5:2409:x1877696867090560:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 3199us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711801.485458:0:19887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 94 00000100:00100000:3.0:1790711801.485507:0:19887:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867090176 00000100:00100000:3.0:1790711801.485518:0:19887:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867090176 00000100:00100000:3.0:1790711801.485601:0:19887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 95 00000100:00100000:3.0:1790711801.485610:0:19887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd8dab27-e45a-4078-a622-860b4e154abb+5:2409:x1877696867090176:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1790711801.485678:0:19887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd8dab27-e45a-4078-a622-860b4e154abb+5:2409:x1877696867090176:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 69us (3660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711801.485697:0:19887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 95 00000100:00100000:1.0:1790711801.486166:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711801.486205:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867090432 00000100:00100000:1.0:1790711801.486210:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867090432 00000100:00100000:1.0:1790711801.486247:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 96 00000100:00100000:1.0:1790711801.486254:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dcc816c-d0f0-4a8d-9916-06e09abe652f+6:2409:x1877696867090432:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1790711801.486289:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dcc816c-d0f0-4a8d-9916-06e09abe652f+6:2409:x1877696867090432:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 36us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711801.486329:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 96 00000100:00080000:1.0:1790711801.488755:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790711801.488771:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1790711801.628237:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790711801.708653:0:19380:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8dcc816c-d0f0-4a8d-9916-06e09abe652f 00000020:00000080:2.0:1790711801.708662:0:19380:0:(genops.c:885:class_export_put()) final put ffff9dab82cf0800/8dcc816c-d0f0-4a8d-9916-06e09abe652f 00000020:00000080:3.0:1790711801.708721:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab82cf0800/8dcc816c-d0f0-4a8d-9916-06e09abe652f for lustre-OST0001 00000020:00000080:3.0:1790711801.708805:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dacae5cd000 for lustre-OST0001 00000001:00100000:1.0:1790711801.713146:0:18561:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8dcc816c-d0f0-4a8d-9916-06e09abe652f 00000020:00000080:1.0:1790711801.713169:0:18561:0:(genops.c:885:class_export_put()) final put ffff9dacbc469800/8dcc816c-d0f0-4a8d-9916-06e09abe652f 00000001:00100000:1.0:1790711801.713197:0:18561:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd8dab27-e45a-4078-a622-860b4e154abb 00000020:00000080:1.0:1790711801.713200:0:18561:0:(genops.c:885:class_export_put()) final put ffff9dab82cf1000/dd8dab27-e45a-4078-a622-860b4e154abb 00000020:00000080:3.0:1790711801.713264:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbc469800/8dcc816c-d0f0-4a8d-9916-06e09abe652f for lustre-OST0000 00000020:00000080:3.0:1790711801.713348:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab82cf1000/dd8dab27-e45a-4078-a622-860b4e154abb for lustre-OST0000 00000020:00000080:3.0:1790711801.713369:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dacbc46d000 for lustre-OST0000 00000020:00000080:3.0:1790711801.713375:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab82cf1800 for lustre-OST0000 00010000:00010000:3.0:1790711802.654725:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790711802.718844:0:17038:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1790711802.718866:0:17038:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1790711802.718934:0:17097:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1790711802.718953:0:17097:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:1.0:1790711803.226931:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790711803.228194:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879755776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790711803.228300:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711803.228630:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790711803.228641:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbf9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879755904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790711803.228670:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711803.235428:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1803113-c9d6-45cb-a2b6-061f96b8256e:3609:1877696879756032:0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.235522:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711803.235589:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1877696879756544:0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.235619:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711803.235638:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1877696879757056:0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.235655:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711803.235680:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790711803.235685:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879756160:0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.235708:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711803.235728:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879756672:0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.235747:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711803.235761:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879757184:0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.235777:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711803.235807:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879756032 00000100:00100000:3.0:1790711803.235816:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879756032 00000100:00100000:3.0:1790711803.235866:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790711803.235875:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1803113-c9d6-45cb-a2b6-061f96b8256e+24:3609:x1877696879756032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.235937:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1803113-c9d6-45cb-a2b6-061f96b8256e+24:3609:x1877696879756032:12345-0@lo:400:kworker.0 Request processed in 62us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711803.235946:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1790711803.235983:0:17059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879756544 00000100:00100000:3.0:1790711803.235986:0:17059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879756544 00000100:00100000:3.0:1790711803.236009:0:17059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879757056 00000100:00100000:3.0:1790711803.236012:0:17059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879757056 00000100:00100000:3.0:1790711803.236040:0:17059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879757184 00000100:00100000:3.0:1790711803.236043:0:17059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879757184 00000100:00100000:3.0:1790711803.236058:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790711803.236064:0:17059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1877696879756544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.236096:0:17059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1877696879756544:12345-0@lo:400:kworker.0 Request processed in 33us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711803.236102:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790711803.236112:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790711803.236117:0:17059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1877696879757056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.236137:0:17059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1877696879757056:12345-0@lo:400:kworker.0 Request processed in 21us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711803.236142:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790711803.236150:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790711803.236155:0:17059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1877696879757184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.236174:0:17059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1877696879757184:12345-0@lo:400:kworker.0 Request processed in 20us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711803.236179:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790711803.236197:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879756160 00000100:00100000:3.0:1790711803.236200:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879756160 00000100:00100000:3.0:1790711803.236220:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879756672 00000100:00100000:3.0:1790711803.236228:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879756672 00000100:00100000:3.0:1790711803.236240:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790711803.236245:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879756160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.236276:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879756160:12345-0@lo:400:kworker.0 Request processed in 31us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711803.236294:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790711803.236304:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790711803.236309:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879756672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.236929:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879756672:12345-0@lo:400:kworker.0 Request processed in 614us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711803.236937:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790711803.237010:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879756160:0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.237023:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879756672:0@lo:400:kworker.0 00010000:00080000:3.0:1790711803.237041:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83b44a80 x1877696879757184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711803.237053:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879757184:0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.237069:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1803113-c9d6-45cb-a2b6-061f96b8256e:3609:1877696879756032:0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.237080:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1877696879756544:0@lo:400:kworker.0 00000100:00100000:3.0:1790711803.237089:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1877696879757056:0@lo:400:kworker.0 00000100:00080000:1.0:1790711803.237239:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790711803.237245:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790711803.237263:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879756416:0@lo:400:kworker.0 00000100:00100000:1.0:1790711803.237320:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711803.237343:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879756928:0@lo:400:kworker.0 00000100:00100000:1.0:1790711803.237367:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711803.237394:0:18860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879756416 00000100:00100000:1.0:1790711803.237401:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879757440:0@lo:400:kworker.0 00000100:00100000:0.0:1790711803.237403:0:18860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879756416 00000100:00100000:1.0:1790711803.237450:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711803.237457:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790711803.237467:0:18860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879756416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711803.237474:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790711803.237483:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879756288:0@lo:400:kworker.0 00000100:00100000:1.0:1790711803.237517:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711803.237526:0:18860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879756416:12345-0@lo:400:kworker.0 Request processed in 60us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711803.237557:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879756800:0@lo:400:kworker.0 00000100:00100000:1.0:1790711803.237585:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711803.237604:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879757312:0@lo:400:kworker.0 00000100:00100000:1.0:1790711803.237626:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711803.237647:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879756416:0@lo:400:kworker.0 00000100:00080000:1.0:1790711803.237665:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790711803.237676:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879756288 00000100:00100000:1.0:1790711803.237679:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879756288 00000100:00100000:1.0:1790711803.237709:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879756800 00000100:00100000:1.0:1790711803.237712:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879756800 00000100:00100000:1.0:1790711803.237727:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790711803.237733:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879756288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711803.237771:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879756288:12345-0@lo:400:kworker.0 Request processed in 38us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711803.237778:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790711803.237792:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790711803.237798:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879756800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711803.237824:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879756800:12345-0@lo:400:kworker.0 Request processed in 26us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711803.237830:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1790711803.237844:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790711803.238027:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879756288:0@lo:400:kworker.0 00000100:00100000:1.0:1790711803.238040:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879756800:0@lo:400:kworker.0 00000100:00100000:0.0:1790711803.238041:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790711803.239792:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879755776 00000100:00100000:2.0:1790711803.239806:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879755776 00000100:00100000:2.0:1790711803.239879:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879755904 00000100:00100000:2.0:1790711803.239883:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879755904 00000100:00100000:2.0:1790711803.239901:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790711803.240161:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879755776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790711803.240202:0:18569:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790711803.240308:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879755776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 152us (12008us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711803.240315:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790711803.240335:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790711803.240342:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879755904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790711803.240352:0:18569:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790711803.240392:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879755904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (11721us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711803.240398:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1790711803.240490:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790711803.240576:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879755776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790711803.240620:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbf9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879755904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790711803.241021:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879756928 00000100:00100000:2.0:1790711803.241028:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879756928 00000100:00100000:2.0:1790711803.241074:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879757440 00000100:00100000:2.0:1790711803.241077:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879757440 00000100:00100000:2.0:1790711803.241099:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879757312 00000100:00100000:2.0:1790711803.241102:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879757312 00000100:00100000:2.0:1790711803.241121:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790711803.241128:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879756928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711803.241178:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879756928:12345-0@lo:400:kworker.0 Request processed in 51us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711803.241185:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790711803.241196:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790711803.241202:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1877696879757440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711803.241228:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1877696879757440:12345-0@lo:400:kworker.0 Request processed in 26us (3778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711803.241234:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790711803.241244:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790711803.241250:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1877696879757312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711803.241276:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1877696879757312:12345-0@lo:400:kworker.0 Request processed in 26us (3649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711803.241294:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1790711803.241315:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790711803.241318:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790711803.241380:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879757312:0@lo:400:kworker.0 00000100:00100000:1.0:1790711803.241393:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879756928:0@lo:400:kworker.0 00010000:00080000:1.0:1790711803.241407:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83b45180 x1877696879757440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711803.241419:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879757440:0@lo:400:kworker.0 00010000:00010000:0.0:1790711803.674839:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711803.741104:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879757568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790711803.741212:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711803.741340:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879757568 00000100:00100000:0.0:1790711803.741352:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879757568 00000100:00100000:0.0:1790711803.741425:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790711803.741440:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879757568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790711803.741480:0:18569:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790711803.741570:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879757568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711803.741579:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790711803.741685:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879757568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790711804.700208:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711804.762988:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790711804.763017:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879757696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790711804.763110:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711804.763322:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879757696 00000100:00100000:0.0:1790711804.763334:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879757696 00000100:00100000:0.0:1790711804.763403:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790711804.763415:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879757696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790711804.763446:0:18569:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790711804.763518:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879757696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711804.763526:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790711804.763588:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879757696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790711805.596128:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711805.597888:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867090816 00000100:00100000:0.0:1790711805.597911:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867090816 00000100:00100000:0.0:1790711805.598052:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:0.0:1790711805.598070:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd8dab27-e45a-4078-a622-860b4e154abb+13:16335:x1877696867090816:12345-192.168.203.6@tcp:35:umount.0 00000100:00080000:2.0:1790711805.598658:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1790711805.598853:0:17062:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1790711805.598950:0:17062:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1790711805.599138:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd8dab27-e45a-4078-a622-860b4e154abb+16:16335:x1877696867090816:12345-192.168.203.6@tcp:35:umount.0 Request processed in 1072us (3026us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1790711805.599150:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 13 00000020:00080000:0.0:1790711805.599157:0:17062:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1790711805.610005:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711805.610066:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711805.610110:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711805.610187:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867090944 00000100:00100000:2.0:1790711805.610201:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867090944 00000100:00100000:3.0:1790711805.610236:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867091072 00000100:00100000:3.0:1790711805.610243:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867091072 00000100:00100000:2.0:1790711805.610279:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867091200 00000100:00100000:2.0:1790711805.610284:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867091200 00000100:00100000:3.0:1790711805.610294:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:3.0:1790711805.610316:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c36a011-7992-43aa-a826-3c761edae35d+15:2408:x1877696867090944:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790711805.610354:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790711805.610379:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac9bef7600/0xcf3cf816241e05f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa3b0 expref: 15 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711805.610399:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790711805.610474:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c36a011-7992-43aa-a826-3c761edae35d+14:2408:x1877696867090944:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 169us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711805.610482:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:3.0:1790711805.610509:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:3.0:1790711805.610516:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dac894dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c36a011-7992-43aa-a826-3c761edae35d+13:2408:x1877696867091072:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790711805.610524:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790711805.610533:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d12a00/0xcf3cf816241e05f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa3e1 expref: 13 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711805.610899:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790711805.610988:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dac894dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c36a011-7992-43aa-a826-3c761edae35d+12:2408:x1877696867091072:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 470us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711805.610996:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:3.0:1790711805.611056:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:3.0:1790711805.611064:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c36a011-7992-43aa-a826-3c761edae35d+11:2408:x1877696867091200:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790711805.611073:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790711805.611085:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac9bef7800/0xcf3cf816241e06b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa497 expref: 11 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711805.611100:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790711805.611119:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c36a011-7992-43aa-a826-3c761edae35d+10:2408:x1877696867091200:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 57us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711805.611135:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:2.0:1790711805.615199:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711805.616815:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867091328 00000100:00100000:0.0:1790711805.616833:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867091328 00000100:00100000:0.0:1790711805.616960:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 35 00000100:00100000:0.0:1790711805.616981:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd8dab27-e45a-4078-a622-860b4e154abb+5:2406:x1877696867091328:12345-192.168.203.6@tcp:9:umount.0 00000020:00000080:0.0:1790711805.617040:0:19653:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e061b 00000100:00080000:0.0:1790711805.617052:0:19653:0:(import.c:65:import_set_state_nolock()) ffff9dab82cf5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790711805.617129:0:19653:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00010000:00010000:3.0:1790711805.617496:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711805.617928:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd8dab27-e45a-4078-a622-860b4e154abb+2:2406:x1877696867091328:12345-192.168.203.6@tcp:9:umount.0 Request processed in 955us (2741us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711805.617939:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 35 00000100:00080000:2.0:1790711805.619200:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790711805.638687:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711805.638856:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867092224 00000100:00100000:2.0:1790711805.638869:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867092224 00000100:00100000:2.0:1790711805.638952:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:2.0:1790711805.638965:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd8dab27-e45a-4078-a622-860b4e154abb+16:2406:x1877696867092224:12345-192.168.203.6@tcp:39:umount.0 00000020:00000080:2.0:1790711805.639014:0:17060:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0606 00000020:00010000:2.0:1790711805.639037:0:17060:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9dab810b4800: total 0 00000100:00080000:2.0:1790711805.639043:0:17060:0:(import.c:65:import_set_state_nolock()) ffff9dab810b7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790711805.639087:0:17060:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1790711805.639331:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd8dab27-e45a-4078-a622-860b4e154abb+15:2406:x1877696867092224:12345-192.168.203.6@tcp:39:umount.0 Request processed in 368us (658us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1790711805.639341:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 67 00000020:00010000:0.0:1790711805.639513:0:17047:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9dab810b4800: total 0 00010000:00010000:0.0:1790711805.639519:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711805.639637:0:17047:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dab810b4800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1790711805.639685:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dacb44d8b00) 00010000:00010000:0.0:1790711805.639689:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790711805.639699:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e0860 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa51c expref: 14 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711805.639722:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dacb44d8b00) 00010000:00010000:0.0:1790711805.639744:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790711805.639749:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d12600/0xcf3cf816241e082f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa507 expref: 13 pid: 19887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711805.639768:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9dacafd1f900) 00010000:00010000:0.0:1790711805.639771:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790711805.639775:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7200/0xcf3cf816241e08bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa531 expref: 12 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711805.639795:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9dacb44d8b00) 00010000:00010000:0.0:1790711805.639798:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790711805.639801:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacbcb74c00/0xcf3cf816241e0916 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa554 expref: 11 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711805.639819:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dacb44d8600) 00010000:00010000:0.0:1790711805.639822:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790711805.639825:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d13c00/0xcf3cf816241e06ed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa4a5 expref: 10 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711805.639841:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dac90a08400) 00010000:00010000:0.0:1790711805.639844:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790711805.639848:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec400/0xcf3cf816241e072c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa4b3 expref: 9 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711805.639862:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dac90a08200) 00010000:00010000:0.0:1790711805.639864:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790711805.639867:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ed200/0xcf3cf816241e06d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa49e expref: 8 pid: 19887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711805.639898:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9dac90a08a00) 00010000:00010000:0.0:1790711805.639901:0:17047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790711805.639905:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7000/0xcf3cf816241e07b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa4dd expref: 7 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711805.639917:0:17047:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dab810b4800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1790711805.639932:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711805.639934:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711805.639936:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711805.651844:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711805.651961:0:19887:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867092352 00000100:00100000:1.0:1790711805.651985:0:19887:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867092352 00000100:00100000:1.0:1790711805.652082:0:19887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 68 00000100:00100000:1.0:1790711805.652121:0:19887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd8dab27-e45a-4078-a622-860b4e154abb+5:2406:x1877696867092352:12345-192.168.203.6@tcp:39:umount.0 00000020:00000080:1.0:1790711805.652168:0:19887:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e060d 00000100:00080000:1.0:1790711805.652193:0:19887:0:(import.c:65:import_set_state_nolock()) ffff9dab810b2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790711805.652231:0:19887:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1790711805.652584:0:19887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd8dab27-e45a-4078-a622-860b4e154abb+3:2406:x1877696867092352:12345-192.168.203.6@tcp:39:umount.0 Request processed in 421us (712us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790711805.652594:0:19887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 68 00010000:00010000:0.0:1790711805.653006:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790711805.653733:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1790711805.659379:0:17811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790711805.723427:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711805.787110:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879757952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790711805.787216:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711805.787218:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879757824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790711805.787307:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879757952 00000100:00100000:3.0:1790711805.787319:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879757952 00000100:00100000:3.0:1790711805.787390:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790711805.787401:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879757952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790711805.787446:0:17063:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1790711805.791268:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879757952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3842us (4025us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711805.792531:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879757952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790711805.792925:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711805.793062:0:18075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879757824 00000100:00100000:0.0:1790711805.793075:0:18075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879757824 00000100:00100000:3.0:1790711805.793167:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790711805.793912:0:18075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790711805.793931:0:18075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879757824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790711805.793986:0:18075:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790711805.794102:0:18075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879757824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711805.794110:0:18075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790711805.794489:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879757824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790711806.594738:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711806.594796:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711806.594840:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711806.595886:0:17059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867092736 00000100:00100000:3.0:1790711806.595903:0:17059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867092736 00000100:00100000:3.0:1790711806.596001:0:17059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867092608 00000100:00100000:3.0:1790711806.596005:0:17059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867092608 00000100:00100000:3.0:1790711806.596039:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 103 00000100:00080000:1.0:1790711806.596047:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790711806.596051:0:17059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dcc816c-d0f0-4a8d-9916-06e09abe652f+5:2407:x1877696867092736:12345-192.168.203.6@tcp:400:kworker.0 00000100:00080000:1.0:1790711806.596052:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790711806.596066:0:19887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 104 00000100:00100000:1.0:1790711806.596074:0:19887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8dcc816c-d0f0-4a8d-9916-06e09abe652f+6:2407:x1877696867092608:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1790711806.596151:0:19887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8dcc816c-d0f0-4a8d-9916-06e09abe652f+6:2407:x1877696867092608:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 78us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711806.596159:0:19887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 104 00000100:00100000:0.0:1790711806.596168:0:17052:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867092480 00000100:00100000:0.0:1790711806.596172:0:17052:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867092480 00000100:00100000:0.0:1790711806.596214:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 177 00000100:00100000:0.0:1790711806.596248:0:17052:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c36a011-7992-43aa-a826-3c761edae35d+10:2407:x1877696867092480:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1790711806.601696:0:17059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8dcc816c-d0f0-4a8d-9916-06e09abe652f+5:2407:x1877696867092736:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 5626us (6878us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711806.601724:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 103 00000100:00100000:0.0:1790711806.607142:0:17052:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c36a011-7992-43aa-a826-3c761edae35d+10:2407:x1877696867092480:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 10867us (12390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711806.607162:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 177 00010000:00010000:0.0:1790711806.747105:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711807.771118:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711808.217013:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711808.217073:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711808.217123:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711808.217370:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867092992 00000100:00100000:0.0:1790711808.217384:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867092992 00000100:00100000:0.0:1790711808.217452:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867092864 00000100:00100000:0.0:1790711808.217456:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867092864 00000100:00100000:3.0:1790711808.217472:0:17044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867093120 00000100:00100000:3.0:1790711808.217478:0:17044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867093120 00000100:00100000:0.0:1790711808.217482:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00100000:0.0:1790711808.217496:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c36a011-7992-43aa-a826-3c761edae35d+12:2407:x1877696867092992:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790711808.217517:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711808.217884:0:17043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac994eca00/0xcf3cf816241e0637 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa451 expref: 12 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711808.217907:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790711808.217986:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c36a011-7992-43aa-a826-3c761edae35d+11:2407:x1877696867092992:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 493us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711808.217995:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00100000:0.0:1790711808.218021:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:0.0:1790711808.218029:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c36a011-7992-43aa-a826-3c761edae35d+10:2407:x1877696867092864:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790711808.218038:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711808.218048:0:17043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d13600/0xcf3cf816241e0630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa420 expref: 10 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711808.218059:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790711808.218098:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c36a011-7992-43aa-a826-3c761edae35d+9:2407:x1877696867092864:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 71us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711808.218106:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:0.0:1790711808.218120:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 8 00000100:00100000:0.0:1790711808.218126:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c36a011-7992-43aa-a826-3c761edae35d+8:2407:x1877696867093120:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790711808.218135:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711808.218144:0:17043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac8167d600/0xcf3cf816241e06ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa490 expref: 8 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711808.218152:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790711808.218169:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c36a011-7992-43aa-a826-3c761edae35d+7:2407:x1877696867093120:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 43us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711808.218175:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 8 00000100:00100000:1.0:1790711808.230526:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711808.230681:0:19887:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867093376 00000100:00100000:2.0:1790711808.230694:0:19887:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867093376 00000100:00100000:2.0:1790711808.230796:0:19887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 69 00000100:00100000:2.0:1790711808.230815:0:19887:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbf9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8dcc816c-d0f0-4a8d-9916-06e09abe652f+6:2406:x1877696867093376:12345-192.168.203.6@tcp:39:umount.0 00000020:00000080:2.0:1790711808.230870:0:19887:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0645 00000020:00010000:2.0:1790711808.230883:0:19887:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9dab82cf5800: total 0 00000100:00080000:2.0:1790711808.230889:0:19887:0:(import.c:65:import_set_state_nolock()) ffff9dab82cf6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790711808.230924:0:19887:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:0.0:1790711808.230944:0:17046:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9dab82cf5800: total 0 00010000:00010000:0.0:1790711808.231021:0:17046:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dab82cf5800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790711808.231071:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dac90a08400) 00010000:00010000:0.0:1790711808.231076:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790711808.231086:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ece00/0xcf3cf816241e073a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa4ba expref: 5 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711808.231120:0:17046:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dab82cf5800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1790711808.231133:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711808.231135:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711808.231137:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711808.231149:0:19887:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbf9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8dcc816c-d0f0-4a8d-9916-06e09abe652f+3:2406:x1877696867093376:12345-192.168.203.6@tcp:39:umount.0 Request processed in 343us (636us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1790711808.231160:0:19887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 69 00000100:00080000:1.0:1790711808.234497:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790711808.247898:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711808.248014:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867093504 00000100:00100000:2.0:1790711808.248028:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867093504 00000100:00100000:2.0:1790711808.248131:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 70 00000100:00100000:2.0:1790711808.248143:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dcc816c-d0f0-4a8d-9916-06e09abe652f+5:2406:x1877696867093504:12345-192.168.203.6@tcp:39:umount.0 00000020:00000080:2.0:1790711808.248197:0:17060:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e064c 00000100:00080000:2.0:1790711808.248210:0:17060:0:(import.c:65:import_set_state_nolock()) ffff9dab82cf7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790711808.248236:0:17060:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:0.0:1790711808.248281:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711808.248462:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8dcc816c-d0f0-4a8d-9916-06e09abe652f+3:2406:x1877696867093504:12345-192.168.203.6@tcp:39:umount.0 Request processed in 321us (578us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790711808.248472:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 70 00000100:00080000:1.0:1790711808.248840:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790711808.309860:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711808.309985:0:17050:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867093760 00000100:00100000:3.0:1790711808.310001:0:17050:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867093760 00000100:00100000:2.0:1790711808.310165:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 178 00000100:00100000:2.0:1790711808.310180:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c36a011-7992-43aa-a826-3c761edae35d+7:2406:x1877696867093760:12345-192.168.203.6@tcp:251:umount.0 00000020:00000080:2.0:1790711808.310252:0:17053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e05e3 00000020:00010000:2.0:1790711808.310261:0:17053:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9dab84247000: total 0 00000100:00080000:2.0:1790711808.310271:0:17053:0:(import.c:65:import_set_state_nolock()) ffff9dab84244000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790711808.310485:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c36a011-7992-43aa-a826-3c761edae35d+3:2406:x1877696867093760:12345-192.168.203.6@tcp:251:umount.0 Request processed in 308us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711808.310495:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 178 00000020:00010000:0.0:1790711808.312234:0:17046:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9dab84247000: total 0 00010000:00010000:0.0:1790711808.312257:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711808.312349:0:17046:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dab84247000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790711808.312436:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac994ed000/0xcf3cf816241e05ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa3a9 expref: 2 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711808.312459:0:17046:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dab84247000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1790711808.312471:0:17046:0:(genops.c:885:class_export_put()) final put ffff9dab84247000/3c36a011-7992-43aa-a826-3c761edae35d 00010000:00010000:0.0:1790711808.312500:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711808.312502:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711808.312504:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790711808.312785:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84247000/3c36a011-7992-43aa-a826-3c761edae35d for MGS 00000020:00000080:3.0:1790711808.312845:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab84244000 for MGS 00000100:00100000:0.0:1790711808.347075:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790711808.347109:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879758080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790711808.347209:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711808.347367:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879758080 00000100:00100000:1.0:1790711808.347380:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879758080 00000100:00100000:1.0:1790711808.347459:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790711808.347471:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879758080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790711808.347512:0:18569:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790711808.347612:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879758080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711808.347620:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1790711808.347734:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790711808.347762:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879758080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790711808.347965:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790711808.347976:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879758208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790711808.348008:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711808.348084:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879758208 00000100:00100000:3.0:1790711808.348109:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879758208 00000100:00100000:3.0:1790711808.348155:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790711808.348163:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879758208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790711808.348177:0:18568:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790711808.348221:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879758208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711808.348228:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790711808.348271:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879758208:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790711808.348342:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790711808.348745:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790711808.349238:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790711808.349266:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879758464:0@lo:400:kworker.0 00000100:00100000:2.0:1790711808.349323:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711808.349759:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879758464 00000100:00100000:3.0:1790711808.349768:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879758464 00000100:00100000:3.0:1790711808.349817:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790711808.349826:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879758464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711808.349895:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879758464:12345-0@lo:400:kworker.0 Request processed in 69us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711808.349902:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790711808.350006:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879758464:0@lo:400:kworker.0 00000100:00100000:0.0:1790711808.352554:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879758336:0@lo:400:kworker.0 00000100:00100000:0.0:1790711808.352676:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711808.355712:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879758592:0@lo:400:kworker.0 00000100:00100000:3.0:1790711808.355826:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711808.358181:0:17052:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879758336 00000100:00100000:2.0:1790711808.358203:0:17052:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879758336 00000100:00100000:2.0:1790711808.358289:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790711808.358301:0:17052:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1803113-c9d6-45cb-a2b6-061f96b8256e+24:3608:x1877696879758336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711808.358438:0:17052:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1803113-c9d6-45cb-a2b6-061f96b8256e+24:3608:x1877696879758336:12345-0@lo:400:kworker.0 Request processed in 140us (5762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711808.358445:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790711808.363170:0:18860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879758592 00000100:00100000:0.0:1790711808.363193:0:18860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879758592 00000100:00100000:0.0:1790711808.363326:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790711808.363347:0:18860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879758592:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790711808.363491:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790711808.367846:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879758336:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.368257:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1877696879758720:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.368316:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711808.368355:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879759232:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.368378:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711808.368400:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790711808.368405:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1877696879759104:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.368426:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711808.368443:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1877696879759616:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.368464:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711808.368501:0:17058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879758720 00000100:00100000:1.0:1790711808.368509:0:17058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879758720 00000100:00100000:1.0:1790711808.368578:0:17058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879759232 00000100:00100000:1.0:1790711808.368582:0:17058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879759232 00000100:00100000:1.0:1790711808.368609:0:17058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879759104 00000100:00100000:1.0:1790711808.368611:0:17058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879759104 00000100:00100000:1.0:1790711808.368622:0:17058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879759616 00000100:00100000:1.0:1790711808.368625:0:17058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879759616 00000100:00100000:1.0:1790711808.368642:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790711808.368671:0:17058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1877696879758720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.368722:0:17058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1877696879758720:12345-0@lo:400:kworker.0 Request processed in 51us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711808.368731:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790711808.368762:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790711808.368769:0:17058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1877696879759232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.368808:0:17058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1877696879759232:12345-0@lo:400:kworker.0 Request processed in 40us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711808.368814:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790711808.368825:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790711808.368830:0:17058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1877696879759104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.368856:0:17058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1877696879759104:12345-0@lo:400:kworker.0 Request processed in 25us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711808.368862:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790711808.368871:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790711808.368876:0:17058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1877696879759616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.368898:0:17058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1877696879759616:12345-0@lo:400:kworker.0 Request processed in 23us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711808.368903:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1790711808.368924:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790711808.368928:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790711808.368959:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1877696879759104:0@lo:400:kworker.0 00010000:00080000:1.0:1790711808.368973:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dacb51d5f80 x1877696879759616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711808.368984:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1877696879759616:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369006:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1877696879758720:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369014:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879759232:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369052:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879758976:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369079:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711808.369101:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879759488:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369117:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711808.369132:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790711808.369138:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879758848:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369158:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711808.369176:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1877696879759360:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369194:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711808.369217:0:18567:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879758976 00000100:00100000:1.0:1790711808.369221:0:18567:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879758976 00000100:00100000:1.0:1790711808.369270:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790711808.369277:0:18567:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879758976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369311:0:18567:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879758976:12345-0@lo:400:kworker.0 Request processed in 35us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711808.369316:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790711808.369334:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879758848 00000100:00100000:1.0:1790711808.369337:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879758848 00000100:00100000:1.0:1790711808.369362:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790711808.369369:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879758848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369403:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879758848:12345-0@lo:400:kworker.0 Request processed in 35us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711808.369409:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790711808.369433:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879759488 00000100:00100000:1.0:1790711808.369437:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879759488 00000100:00100000:1.0:1790711808.369461:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879759360 00000100:00100000:1.0:1790711808.369464:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879759360 00000100:00100000:1.0:1790711808.369481:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790711808.369487:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1877696879759488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369519:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1877696879759488:12345-0@lo:400:kworker.0 Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711808.369525:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790711808.369537:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790711808.369608:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1877696879759360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369635:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1877696879759360:12345-0@lo:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711808.369641:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1790711808.369657:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790711808.369660:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790711808.369663:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790711808.369692:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879758848:0@lo:400:kworker.0 00010000:00080000:1.0:1790711808.369703:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dacb51d4e00 x1877696879759360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711808.369712:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1877696879759360:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369722:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879758976:0@lo:400:kworker.0 00000100:00100000:1.0:1790711808.369731:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879759488:0@lo:400:kworker.0 00000100:00100000:0.0:1790711808.375091:0:18860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879758592:12345-0@lo:400:kworker.0 Request processed in 11735us (19248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711808.375113:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790711808.375653:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879758592:0@lo:400:kworker.0 00010000:00010000:0.0:1790711808.796398:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711808.861145:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879759744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790711808.861265:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711808.861814:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879759744 00000100:00100000:0.0:1790711808.861836:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879759744 00000100:00100000:0.0:1790711808.861912:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790711808.861924:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879759744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790711808.861971:0:18568:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790711808.862052:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879759744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711808.862059:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790711808.862140:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879759744:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1790711809.564798:0:17092:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790711809.564808:0:17092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790711809.564829:0:17092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790711809.564838:0:17092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1790711809.828437:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711809.891332:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790711809.891359:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879759872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790711809.891436:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711809.891605:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879759872 00000100:00100000:1.0:1790711809.891613:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879759872 00000100:00100000:1.0:1790711809.891660:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790711809.891670:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879759872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790711809.891694:0:18568:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790711809.891741:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879759872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711809.891748:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790711809.891841:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879759872:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1790711810.579103:0:20631:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790711810.604875:0:20631:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1790711810.604950:0:20631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185000/0xcf3cf816241e01a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e01ad expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.604965:0:20631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185000/0xcf3cf816241e01a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e01ad expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.604973:0:20631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185000/0xcf3cf816241e01a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e01ad expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.604993:0:20631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dacb5185000/0xcf3cf816241e01a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e01ad expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.605020:0:20631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790711810.605026:0:20631:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790711810.605052:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790711810.605056:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790711810.605061:0:20631:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790711810.605089:0:20631:0:(import.c:65:import_set_state_nolock()) ffff9dacbfa36000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790711810.605146:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877696879760000:0@lo:39:umount.0 00000100:00100000:2.0:1790711810.605218:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790711810.605288:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711810.605295:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dacb5185000/0xcf3cf816241e01a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e01ad expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711810.605303:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5185000 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711810.605307:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dacb5185000/0xcf3cf816241e01a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e01ad expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711810.605316:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dacb5185000/0xcf3cf816241e01a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e01ad expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711810.605324:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dacb5185000/0xcf3cf816241e01a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e01ad expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711810.605338:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790711810.605340:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790711810.605343:0:17047:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790711810.605368:0:17047:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dacb5185000/0xcf3cf816241e01a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e01ad expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711810.605375:0:17047:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711810.605405:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dacb5185000/0xcf3cf816241e01a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e01ad expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711810.605412:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dacb5185000/0xcf3cf816241e01a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e01ad expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711810.605415:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879760128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790711810.605423:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711810.605425:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711810.605427:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711810.605446:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711810.605469:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879760000 00000100:00100000:1.0:1790711810.605477:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879760000 00000100:00100000:1.0:1790711810.605530:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790711810.605560:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877696879760000:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790711810.605585:0:17060:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e01d7 00000100:00080000:1.0:1790711810.605593:0:17060:0:(import.c:65:import_set_state_nolock()) ffff9dacbfae3800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790711810.605630:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711810.605663:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3606:x1877696879760000:12345-0@lo:39:umount.0 Request processed in 124us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711810.605671:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1790711810.605680:0:17060:0:(genops.c:885:class_export_put()) final put ffff9dacbfae5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790711810.605704:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbfae5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790711810.605742:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dacbfae3800 for lustre-MDT0000 00000100:00080000:2.0:1790711810.605846:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacbfa36000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790711810.605865:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877696879760000:0@lo:39:umount.0 00000100:00080000:1.0:1790711810.606614:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790711810.606620:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790711810.606625:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790711810.607750:0:20631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac994ed600/0xcf3cf816241e00f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e00fe expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607766:0:20631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac994ed600/0xcf3cf816241e00f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e00fe expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607784:0:20631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac994ed600/0xcf3cf816241e00f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e00fe expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607791:0:20631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dac994ed600/0xcf3cf816241e00f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e00fe expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607820:0:20631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790711810.607827:0:20631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e050a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607834:0:20631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e050a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607839:0:20631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e050a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607845:0:20631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e050a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607854:0:20631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790711810.607860:0:20631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e06a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e06a7 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607866:0:20631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e06a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e06a7 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607871:0:20631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e06a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e06a7 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607886:0:20631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e06a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e06a7 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607893:0:20631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1790711810.607898:0:20631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e00e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e00f0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.607904:0:20631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e00e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e00f0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.607970:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790711810.607978:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac994ed600/0xcf3cf816241e00f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e00fe expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.607986:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac994ed600 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:2.0:1790711810.607990:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac994ed600/0xcf3cf816241e00f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e00fe expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608010:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac994ed600/0xcf3cf816241e00f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e00fe expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790711810.608017:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac994ed600/0xcf3cf816241e00f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e00fe expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711810.608023:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790711810.608025:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1790711810.608058:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dac994ed600/0xcf3cf816241e00f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e00fe expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608064:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790711810.608085:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac994ed600/0xcf3cf816241e00f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e00fe expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608092:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac994ed600/0xcf3cf816241e00f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e00fe expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608104:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790711810.608107:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e050a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608112:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167dc00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:2.0:1790711810.608114:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e050a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608120:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e050a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790711810.608126:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e050a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711810.608137:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790711810.608139:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1790711810.608141:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1790711810.608143:0:20631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e00e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e00f0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.608150:0:20631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e00e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e00f0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608155:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e050a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711810.608158:0:20631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790711810.608161:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1790711810.608161:0:20631:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1790711810.608164:0:20631:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1790711810.608167:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0503 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e050a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608172:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e050a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608180:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790711810.608183:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e06a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e06a7 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608188:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167d000 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:2.0:1790711810.608191:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e06a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e06a7 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790711810.608195:0:20631:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00010000:00010000:2.0:1790711810.608197:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e06a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e06a7 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1790711810.608199:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 10000000:00010000:2.0:1790711810.608202:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e06a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e06a7 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790711810.608203:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:2.0:1790711810.608207:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00000080:1.0:1790711810.608207:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 10000000:01000000:2.0:1790711810.608209:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790711810.608215:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:1.0:1790711810.608215:0:20631:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9dab84240000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790711810.608220:0:20631:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9dab8209d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790711810.608234:0:20631:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9daca0100000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1790711810.608237:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e06a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e06a7 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790711810.608239:0:20631:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9daca0135800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1790711810.608244:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1790711810.608253:0:20631:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9dab82cf5800 8dcc816c-d0f0-4a8d-9916-06e09abe652f 192.168.203.6@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1790711810.608258:0:20631:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9dab810b4800 dd8dab27-e45a-4078-a622-860b4e154abb 192.168.203.6@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:1.0:1790711810.608263:0:20631:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9dacb53f4d40) has exports, disconnecting them 00010000:00010000:2.0:1790711810.608264:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e06a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e06a7 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790711810.608267:0:20631:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dab84240000), last request at 1790711808 00010000:00010000:2.0:1790711810.608271:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e06a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e06a7 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790711810.608273:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e04e0 00010000:00010000:2.0:1790711810.608280:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711810.608284:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e00e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e00f0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790711810.608287:0:20631:0:(import.c:65:import_set_state_nolock()) ffff9dab84246000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790711810.608289:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d15a00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:2.0:1790711810.608292:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e00e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e00f0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608299:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e00e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e00f0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790711810.608305:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e00e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e00f0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711810.608309:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1790711810.608312:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790711810.608313:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:1.0:1790711810.608323:0:20631:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dab84240000): rc 0 00010000:00010000:2.0:1790711810.608324:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e00e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e00f0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790711810.608326:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dab84240000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1790711810.608330:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1790711810.608336:0:20631:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9dab8209d000), last request at 1790711808 00000020:00000080:1.0:1790711810.608339:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0374 00010000:00010000:2.0:1790711810.608341:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e00e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e00f0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790711810.608343:0:20631:0:(import.c:65:import_set_state_nolock()) ffff9dab8209a800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790711810.608347:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e00e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e00f0 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790711810.608352:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84240000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1790711810.608355:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711810.608357:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711810.608359:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711810.608372:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1803113-c9d6-45cb-a2b6-061f96b8256e:3609:1877696879760256:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1790711810.608380:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab84246000 for lustre-MDT0000 00000020:00080000:1.0:1790711810.608391:0:20631:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dab8209d000): rc 0 00000020:00000080:1.0:1790711810.608393:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dab8209d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1790711810.608399:0:20631:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9daca0100000), last request at 1790711723 00000020:00000080:1.0:1790711810.608402:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e02c5 00000100:00080000:1.0:1790711810.608405:0:20631:0:(import.c:65:import_set_state_nolock()) ffff9daca0105800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1790711810.608414:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab8209d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1790711810.608431:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab8209a800 for lustre-MDT0000 00000100:00100000:2.0:1790711810.608432:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1790711810.608439:0:20631:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9daca0100000): rc 0 00000020:00000080:1.0:1790711810.608441:0:20631:0:(genops.c:885:class_export_put()) final put ffff9daca0100000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1790711810.608446:0:20631:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9daca0135800), last request at 1790711723 00000020:00000080:1.0:1790711810.608449:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e026a 00000100:00080000:1.0:1790711810.608453:0:20631:0:(import.c:65:import_set_state_nolock()) ffff9dacbf9b7800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1790711810.608458:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca0100000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1790711810.608473:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790711810.608478:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1803113-c9d6-45cb-a2b6-061f96b8256e:3609:1877696879760384:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1790711810.608484:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9daca0105800 for lustre-MDT0000 00000001:00000004:1.0:1790711810.608494:0:20631:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00100000:2.0:1790711810.608500:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711810.608538:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879760128 00000100:00100000:2.0:1790711810.608564:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879760128 00000100:00100000:2.0:1790711810.608597:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879760256 00000020:00080000:1.0:1790711810.608598:0:20631:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9daca0135800): rc 0 00000100:00100000:2.0:1790711810.608600:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879760256 00000004:00000080:1.0:1790711810.608604:0:20631:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb22b41d73ae0 00000100:00100000:2.0:1790711810.608612:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879760384 00000100:00100000:2.0:1790711810.608614:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879760384 00000100:00080000:1.0:1790711810.608619:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790711810.608622:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1790711810.608625:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790711810.608632:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1803113-c9d6-45cb-a2b6-061f96b8256e+26:3608:x1877696879760128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790711810.608643:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711810.608655:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacb5185e00/0xcf3cf816241e01ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e01a6 expref: 26 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608666:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790711810.608714:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1803113-c9d6-45cb-a2b6-061f96b8256e+25:3608:x1877696879760128:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (3267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711810.608720:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790711810.608742:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790711810.608747:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc449500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1803113-c9d6-45cb-a2b6-061f96b8256e+24:3609:x1877696879760256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790711810.608754:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711810.608761:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d13800/0xcf3cf816241e00fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e00f7 expref: 24 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608770:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790711810.608793:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc449500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1803113-c9d6-45cb-a2b6-061f96b8256e+23:3609:x1877696879760256:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711810.608799:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790711810.608809:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790711810.608814:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dac894de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1803113-c9d6-45cb-a2b6-061f96b8256e+22:3609:x1877696879760384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790711810.608820:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711810.608827:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d15800/0xcf3cf816241e050a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e0503 expref: 22 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.608835:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790711810.608852:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dac894de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1803113-c9d6-45cb-a2b6-061f96b8256e+21:3609:x1877696879760384:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711810.608858:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790711810.609046:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879760640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790711810.609072:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711810.609098:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879760128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790711810.609111:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790711810.609116:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879760512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790711810.609132:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711810.609158:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879760640 00000100:00100000:2.0:1790711810.609162:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879760640 00000100:00100000:2.0:1790711810.609184:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879760512 00000100:00100000:2.0:1790711810.609186:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879760512 00000100:00100000:2.0:1790711810.609197:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790711810.609201:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1803113-c9d6-45cb-a2b6-061f96b8256e+22:3608:x1877696879760640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790711810.609208:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711810.609215:0:17043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacb5184e00/0xcf3cf816241e00f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e00e9 expref: 22 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.609236:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790711810.609298:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc448700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1803113-c9d6-45cb-a2b6-061f96b8256e+21:3608:x1877696879760640:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711810.609304:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790711810.609315:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790711810.609320:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc449500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1803113-c9d6-45cb-a2b6-061f96b8256e+20:3608:x1877696879760512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790711810.609326:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711810.609333:0:17043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac8167de00/0xcf3cf816241e06a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e06a0 expref: 20 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711810.609341:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790711810.609359:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc449500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1803113-c9d6-45cb-a2b6-061f96b8256e+19:3608:x1877696879760512:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711810.609365:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1790711810.609399:0:20631:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790711810.609416:0:20631:0:(import.c:65:import_set_state_nolock()) ffff9dacbfbbb000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1790711810.609536:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711810.609575:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1803113-c9d6-45cb-a2b6-061f96b8256e:3609:1877696879760384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790711810.609583:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1803113-c9d6-45cb-a2b6-061f96b8256e:3609:1877696879760256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790711810.609611:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879760512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790711810.609627:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879760640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790711810.609644:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879760768:0@lo:39:umount.0 00000100:00100000:2.0:1790711810.609673:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711810.609704:0:18075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879760768 00000100:00100000:2.0:1790711810.609708:0:18075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879760768 00000100:00100000:2.0:1790711810.609736:0:18075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790711810.609743:0:18075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877696879760768:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790711810.609765:0:18075:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e02ef 00000100:00080000:2.0:1790711810.609772:0:18075:0:(import.c:65:import_set_state_nolock()) ffff9dab8393a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790711810.609789:0:18075:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790711810.609920:0:18075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3606:x1877696879760768:12345-0@lo:39:umount.0 Request processed in 177us (246us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1790711810.609927:0:18075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:2.0:1790711810.609938:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790711810.609952:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacbfbbb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790711810.609958:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879760768:0@lo:39:umount.0 00010000:00010000:2.0:1790711810.609968:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790711810.612731:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790711810.612738:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1790711810.612760:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790711810.612823:0:20631:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790711810.612846:0:20631:0:(import.c:65:import_set_state_nolock()) ffff9dacb4670800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790711810.612863:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790711810.612865:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1790711810.612874:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790711810.612928:0:20631:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790711810.612936:0:20631:0:(import.c:65:import_set_state_nolock()) ffff9dab83bac000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1790711810.612974:0:20631:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9dacb53f4d40) has no exports 00000001:00100000:2.0:1790711810.612990:0:17038:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790711810.612995:0:17038:0:(genops.c:885:class_export_put()) final put ffff9daca0135800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1790711810.613005:0:17038:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8dcc816c-d0f0-4a8d-9916-06e09abe652f 00000001:00080000:2.0:1790711810.613013:0:17038:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1790711810.613016:0:17038:0:(genops.c:885:class_export_put()) final put ffff9dab82cf5800/8dcc816c-d0f0-4a8d-9916-06e09abe652f 00000001:00100000:2.0:1790711810.613020:0:17038:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd8dab27-e45a-4078-a622-860b4e154abb 00000001:00080000:2.0:1790711810.613023:0:17038:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1790711810.613030:0:17038:0:(genops.c:885:class_export_put()) final put ffff9dab810b4800/dd8dab27-e45a-4078-a622-860b4e154abb 00000100:00100000:2.0:1790711810.613050:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879760896:0@lo:9:umount.0 00000100:00100000:2.0:1790711810.613127:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711810.613169:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879761024:0@lo:9:umount.0 00000100:00100000:2.0:1790711810.613264:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711810.613300:0:18566:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879760896 00000100:00100000:2.0:1790711810.613307:0:18566:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879760896 00000100:00100000:2.0:1790711810.613351:0:18566:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879761024 00000100:00100000:2.0:1790711810.613354:0:18566:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879761024 00000100:00100000:2.0:1790711810.613375:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790711810.613454:0:18566:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877696879760896:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790711810.613481:0:18566:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e03ba 00000100:00080000:2.0:1790711810.613490:0:18566:0:(import.c:65:import_set_state_nolock()) ffff9dab82e89800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790711810.615004:0:18566:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790711810.615179:0:18566:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3606:x1877696879760896:12345-0@lo:9:umount.0 Request processed in 1793us (2049us total) trans 0 rc 0/0 00000100:00080000:3.0:1790711810.615312:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacb4670800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790711810.615320:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790711810.615322:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790711810.615326:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879760896:0@lo:9:umount.0 00000100:00100000:2.0:1790711810.615328:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790711810.615350:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790711810.615360:0:18566:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877696879761024:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790711810.615381:0:18566:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0511 00000100:00080000:2.0:1790711810.615463:0:18566:0:(import.c:65:import_set_state_nolock()) ffff9dab84243000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790711810.615621:0:18566:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000020:00000080:0.0:1790711810.615695:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca0135800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00100000:2.0:1790711810.615733:0:18566:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3606:x1877696879761024:12345-0@lo:9:umount.0 Request processed in 376us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711810.615739:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00000080:0.0:1790711810.615741:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab82cf5800/8dcc816c-d0f0-4a8d-9916-06e09abe652f for lustre-MDT0000 00000100:00080000:2.0:1790711810.615755:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790711810.615759:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1790711810.615764:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab810b4800/dd8dab27-e45a-4078-a622-860b4e154abb for lustre-MDT0000 00000020:00000080:0.0:1790711810.615995:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dacbf9b7800 for lustre-MDT0000 00000020:00000080:0.0:1790711810.616001:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab82cf6800 for lustre-MDT0000 00000020:00000080:0.0:1790711810.616004:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab810b7000 for lustre-MDT0000 00010000:00010000:3.0:1790711810.616099:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711810.616127:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790711810.616150:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab83bac000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790711810.616349:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790711810.616506:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790711810.616520:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879761024:0@lo:9:umount.0 00000020:00080000:1.0:1790711810.635951:0:20631:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9dacb53f4d40) has no exports 00000020:00000080:1.0:1790711810.722066:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0144 00000020:00000080:1.0:1790711810.722083:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacb50c1800/lustre-QMT0000_UUID 00000020:01000000:1.0:1790711810.722103:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1790711810.722210:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacb50c1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1790711810.722241:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790711810.722250:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790711810.722255:0:20631:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9dacb52dcd40) has no exports 00000020:00000080:0.0:1790711810.722688:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e013d 00000020:00000080:0.0:1790711810.722694:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacb50c6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790711810.722735:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacb50c6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790711810.722742:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790711810.722761:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790711810.722764:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacb50c7000/lustre-QMT0000_UUID 00000020:00000080:0.0:1790711810.722767:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacb50c7000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790711810.722771:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1790711810.722888:0:20631:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9dac98882ae0 - data ffff9dac98f52510/ffff9dacae56e400 00000020:01000000:0.0:1790711810.723032:0:20631:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9dac85498720 - data ffff9dac98f7ca20/ffff9dacbde30800 00000001:00000004:0.0:1790711810.737764:0:20631:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1790711810.788366:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790711810.788375:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790711810.788390:0:20631:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9dacb51d4e00 x1877696879760768/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790711820 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711810.788417:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1790711810.793374:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790711810.793381:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1790711810.793404:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790711810.793407:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790711810.795037:0:17082:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790711810.795046:0:17082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1790711810.795060:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1790711810.795872:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790711810.795878:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1790711810.795893:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790711810.795896:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790711810.797252:0:17084:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790711810.797258:0:17084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1790711810.797280:0:17084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1790711810.798920:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e010c 00000020:00000080:0.0:1790711810.798931:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacaf9f3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790711810.799952:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacaf9f3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790711810.800774:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0121 00000020:00000080:0.0:1790711810.800786:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dac8fd6b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790711810.800799:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790711810.800805:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790711810.800810:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dac8fd6b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1790711810.800814:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790711810.800820:0:20631:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9dacb53f19c0) has no exports 00000004:01000000:0.0:1790711810.801004:0:20631:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790711810.801015:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0183 00000020:00000080:0.0:1790711810.801042:0:20631:0:(genops.c:885:class_export_put()) final put ffff9daca0181000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790711810.801056:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790711810.801060:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790711810.801065:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790711810.801068:0:20631:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9dab82d54d40) has no exports 00000020:00000080:0.0:1790711810.801074:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e017c 00000020:00000080:0.0:1790711810.801079:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dab83ba8000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1790711810.801424:0:20631:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790711810.801429:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790711810.801433:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1790711810.801440:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790711810.801442:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790711810.801471:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790711810.801478:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790711810.801483:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e016e 00000020:00000080:0.0:1790711810.801488:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacbfae7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790711810.801491:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1790711810.801495:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790711810.801498:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790711810.801501:0:20631:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9daca0a20000) has no exports 00000020:00000080:0.0:1790711810.801504:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0167 00000020:00000080:0.0:1790711810.801506:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacb4677000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1790711810.801836:0:20631:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1790711810.801840:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790711810.801841:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1790711810.801845:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790711810.801846:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790711810.801867:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790711810.801871:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1790711810.801881:0:20631:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1790711810.801884:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0159 00000020:00000080:0.0:1790711810.801889:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dac8fd6e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790711810.801893:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1790711810.801896:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790711810.801899:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1790711810.801901:0:20631:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff9dab83398000) has no exports 00000020:00000080:0.0:1790711810.801905:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0152 00000020:00000080:0.0:1790711810.801907:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacaf9f7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790711810.804770:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca0181000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790711810.804789:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab83ba8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790711810.804796:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab83bac000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790711810.804804:0:38:0:(genops.c:885:class_export_put()) final put ffff9dacbfae6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790711810.804807:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbfae6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1790711810.804811:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790711810.804903:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbfae7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790711810.804908:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacb4677000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790711810.804913:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dacb4670800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790711810.804917:0:38:0:(genops.c:885:class_export_put()) final put ffff9dac8fd68800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790711810.804919:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dac8fd68800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790711810.804922:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790711810.804959:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dac8fd6e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790711810.804965:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacaf9f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1790711810.805641:0:20631:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1790711810.805648:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790711810.805652:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790711810.805659:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790711810.805768:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790711810.805778:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790711810.805805:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790711810.805808:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790711810.805811:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacaf9f2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790711810.805815:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacaf9f2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790711810.805828:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790711810.805902:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0128 00000020:00000080:1.0:1790711810.805909:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dac8fd6b800/lustre-MDD0000_UUID 00000020:00000080:3.0:1790711810.805981:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dacbfbbb000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1790711810.805988:0:38:0:(genops.c:885:class_export_put()) final put ffff9dab83ba8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790711810.805990:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab83ba8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1790711810.805994:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790711810.806149:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790711810.806153:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790711810.806159:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790711810.806163:0:20631:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9dacb53f0000) has no exports 00000020:00000080:1.0:1790711810.806182:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790711810.806185:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1790711810.806189:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e012f 00000020:00000080:1.0:1790711810.806193:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dac8fd68000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790711810.806202:0:20631:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dacbfbba800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1790711810.806205:0:20631:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dacbfbba800 3 00000020:01000004:1.0:1790711810.806208:0:20631:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dacbfbba800 from lustre-MDT0000 00000020:00000080:1.0:1790711810.806235:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790711810.806239:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790711810.806242:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacaf9f0800/lustre-MDT0000_UUID 00000020:00000080:1.0:1790711810.806244:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacaf9f0800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790711810.806250:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1790711810.806282:0:20631:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1790711810.806286:0:20631:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790711810.806288:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790711810.806291:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790711810.806293:0:20631:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790711810.806300:0:20631:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9dab84212000 e1803113-c9d6-45cb-a2b6-061f96b8256e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790711810.806305:0:20631:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9dab82d519c0) has exports, disconnecting them 00000020:00080000:1.0:1790711810.806309:0:20631:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9dab84212000), last request at 1790711707 00000020:00000080:1.0:1790711810.806322:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e00d4 00000020:00010000:1.0:1790711810.806325:0:20631:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9dab84212000: total 2 00000100:00080000:1.0:1790711810.806328:0:20631:0:(import.c:65:import_set_state_nolock()) ffff9dab84217800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790711810.806338:0:20631:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dab84212000): rc 0 00000020:00080000:1.0:1790711810.806348:0:20631:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9dab82d519c0) has no exports 00000020:00010000:3.0:1790711810.806412:0:17046:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9dab84212000: total 2 00010000:00010000:3.0:1790711810.806442:0:17046:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9dab84212000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1790711810.806472:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d15e00/0xcf3cf816241e0493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e048c expref: 14 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806500:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacb5184200/0xcf3cf816241e0335 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e032e expref: 13 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806511:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac9bef6400/0xcf3cf816241e067d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e0676 expref: 12 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806522:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e01f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e01ec expref: 11 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806535:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac994edc00/0xcf3cf816241e020f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e0208 expref: 10 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806575:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac994ed800/0xcf3cf816241e04bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e04b6 expref: 9 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806584:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacb5184000/0xcf3cf816241e00e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e00db expref: 8 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806593:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacb5184c00/0xcf3cf816241e04fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e04f5 expref: 7 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806603:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacb5185400/0xcf3cf816241e035f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e0358 expref: 6 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806613:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac9bef6200/0xcf3cf816241e068b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e0684 expref: 5 pid: 17052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806622:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d14000/0xcf3cf816241e02b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e02a9 expref: 4 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806649:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d12e00/0xcf3cf816241e0201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e01fa expref: 3 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806661:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac8167da00/0xcf3cf816241e0699 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3cf816241e0692 expref: 2 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711810.806671:0:17046:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9dab84212000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1790711810.806686:0:17046:0:(genops.c:885:class_export_put()) final put ffff9dab84212000/e1803113-c9d6-45cb-a2b6-061f96b8256e 00010000:00010000:3.0:1790711810.806692:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711810.806694:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711810.806696:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711810.806736:0:17050:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff9dab81cc7000:17050] 0 exiting: rc = 1 00000020:00000080:3.0:1790711810.806817:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dac8fd6b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1790711810.806822:0:38:0:(genops.c:885:class_export_put()) final put ffff9dab84215000/lustre-MDD0000_UUID 00000020:00000080:3.0:1790711810.806824:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84215000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1790711810.806828:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1790711810.806860:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dac8fd68000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790711810.806865:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84212000/e1803113-c9d6-45cb-a2b6-061f96b8256e for MGS 00000020:00000080:3.0:1790711810.806894:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab84217800 for MGS 00000100:00100000:1.0:1790711810.809656:0:17052:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff9dab82cdc400:17052] 1 exiting: rc = 0 00000100:00100000:3.0:1790711810.816663:0:17053:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff9dab82cdce00:17053] 2 exiting: rc = 0 00000100:00100000:1.0:1790711810.816875:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816883:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816889:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816895:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816901:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816907:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816912:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816919:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816924:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816931:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816936:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816943:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816949:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816954:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816960:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816965:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816971:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816975:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816981:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816988:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816993:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.816998:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817003:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817008:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817013:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817017:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817040:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817046:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817051:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817056:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817061:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817067:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817073:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817091:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817095:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817100:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817105:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817109:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817114:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817119:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817123:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817128:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817133:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817138:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817144:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817149:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817154:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817160:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817165:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817169:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817174:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817179:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817184:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817189:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817194:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817199:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817204:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817209:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817215:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817427:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817438:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817443:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817449:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711810.817454:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1790711810.818707:0:20631:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9dab82e236c0 - data ffff9dac85c87000/ffff9dab82ebe400 00000020:01000000:1.0:1790711810.818844:0:20631:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9dab81085ba0 - data ffff9dac85dab870/ffff9dacb53a1400 00000020:00000080:1.0:1790711810.819932:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e00b8 00000020:00000080:1.0:1790711810.819955:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dab84259000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790711810.820016:0:20631:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dacbfbba800 from MGS, refs=2 00000020:01000004:1.0:1790711810.820743:0:20631:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dacbfbba800 2 00000020:01000004:1.0:1790711810.820752:0:20631:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dacbfbba800 from MGS 00000020:00000080:1.0:1790711810.820782:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790711810.820791:0:20631:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1790711810.820805:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dab8425f800/MGS 00000020:00000080:1.0:1790711810.820809:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab8425f800/MGS for MGS 00000020:01000000:1.0:1790711810.820818:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1790711810.821014:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1790711810.821032:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790711810.821038:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790711810.821044:0:20631:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9dacaf9f4000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790711810.821051:0:20631:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9dacb52d99c0) has exports, disconnecting them 00000020:00080000:1.0:1790711810.821056:0:20631:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9dacaf9f4000), last request at 1790711707 00000020:00000080:1.0:1790711810.821060:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e01bb 00000020:00080000:1.0:1790711810.821074:0:20631:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dacaf9f4000): rc 0 00000020:00000080:1.0:1790711810.821078:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacaf9f4000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790711810.821560:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84259000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790711810.822326:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacaf9f4000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1790711810.851616:0:20631:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1790711810.851646:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790711810.851651:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790711810.851657:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790711810.851706:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dacbfa36000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790711810.851840:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790711810.851850:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1790711810.851855:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacbf953800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1790711810.851864:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbf953800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1790711810.851874:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1790711810.851953:0:20631:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dacbfbba800 1 00000020:00000080:0.0:1790711810.851959:0:20631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e00aa 00000020:00000080:0.0:1790711810.851965:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dab8425e000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1790711810.851978:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1790711810.851983:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790711810.851987:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790711810.851990:0:20631:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9dacb53f3380) has no exports 00000020:00000080:3.0:1790711810.852413:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab8425e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1790711810.864996:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711810.909028:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790711810.909052:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879761152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790711810.909122:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711810.909171:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879761152 00000100:00100000:0.0:1790711810.909178:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879761152 00000100:00100000:0.0:1790711810.909217:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790711810.909234:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3610:x1877696879761152:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1790711810.909242:0:17063:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790711810.909282:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3610:x1877696879761152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (160us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790711810.909289:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:02020000:0.0:1790711810.909330:0:3610:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:1.0:1790711810.914867:0:19380:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790711810.914876:0:19380:0:(genops.c:885:class_export_put()) final put ffff9dab84243800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1790711810.914900:0:19380:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd8dab27-e45a-4078-a622-860b4e154abb 00000020:00000080:1.0:1790711810.914904:0:19380:0:(genops.c:885:class_export_put()) final put ffff9dab82cf4800/dd8dab27-e45a-4078-a622-860b4e154abb 00000020:00000080:3.0:1790711810.915026:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84243800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1790711810.915075:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab82cf4800/dd8dab27-e45a-4078-a622-860b4e154abb for lustre-OST0001 00000020:00000080:3.0:1790711810.915108:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab84243000 for lustre-OST0001 00000020:00000080:3.0:1790711810.915113:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab82cf5000 for lustre-OST0001 00000100:00080000:0.0:1790711810.922302:0:3610:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790711810.922311:0:3610:0:(import.c:65:import_set_state_nolock()) ffff9dacbf9b0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790711810.922328:0:3610:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790711810.936041:0:3610:0:(import.c:65:import_set_state_nolock()) ffff9dacbf9b0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790711810.936055:0:3610:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:0.0:1790711810.936071:0:3610:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dacbf9b0000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1790711810.936425:0:3610:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51d4e00 x1877696879761280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790711810.936464:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879761280:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1790711810.936557:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711810.936606:0:18075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879761280 00000100:00100000:1.0:1790711810.936613:0:18075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879761280 00000100:00100000:1.0:1790711810.936644:0:18075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790711810.936652:0:18075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3606:x1877696879761280:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1790711810.936684:0:18075:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790711810.990839:0:18075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3606:x1877696879761280:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 54181us (54292us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790711810.990853:0:18075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1790711810.991721:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacbf9b0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790711810.991730:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790711810.991735:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879761280:0@lo:38:ptlrpcd_00_03.0 00000020:00000080:0.0:1790711811.009963:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790711811.009975:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1790711811.009979:0:20631:0:(genops.c:885:class_export_put()) final put ffff9dacbfbbf000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790711811.009984:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbfbbf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1790711811.009993:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1790711811.010120:0:20631:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dacbfbbe000 00000020:02000400:0.0:1790711811.010277:0:20631:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1790711811.871501:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790711811.937150:0:17790:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1790711811.937170:0:17790:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1790711811.937177:0:17790:0:(genops.c:885:class_export_put()) final put ffff9dacbf9b7000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1790711811.937197:0:17790:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8dcc816c-d0f0-4a8d-9916-06e09abe652f 00000001:00080000:3.0:1790711811.937201:0:17790:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1790711811.937203:0:17790:0:(genops.c:885:class_export_put()) final put ffff9dab82cf2800/8dcc816c-d0f0-4a8d-9916-06e09abe652f 00000001:00100000:3.0:1790711811.937225:0:17790:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dd8dab27-e45a-4078-a622-860b4e154abb 00000001:00080000:3.0:1790711811.937231:0:17790:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1790711811.937233:0:17790:0:(genops.c:885:class_export_put()) final put ffff9dab810b0800/dd8dab27-e45a-4078-a622-860b4e154abb 00000020:00000080:3.0:1790711811.937249:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbf9b7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1790711811.937326:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab82cf2800/8dcc816c-d0f0-4a8d-9916-06e09abe652f for lustre-MDT0001 00000020:00000080:3.0:1790711811.937371:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab810b0800/dd8dab27-e45a-4078-a622-860b4e154abb for lustre-MDT0001 00000020:00000080:3.0:1790711811.937399:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab8393a800 for lustre-MDT0001 00000020:00000080:3.0:1790711811.937404:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab82cf7000 for lustre-MDT0001 00000020:00000080:3.0:1790711811.937407:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab810b2000 for lustre-MDT0001 00010000:00010000:3.0:1790711812.890792:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790711813.466788:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790711813.466797:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790711813.466802:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dacbf9b0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790711813.466814:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 577 00000100:00080000:2.0:1790711813.466821:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790711813.466837:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dacbf9b0000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1790711813.466867:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacbc44bb80 x1877696879761536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790711813.466979:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879761536:0@lo:38:kworker.0 00000100:00100000:3.0:1790711813.467131:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e1803113-c9d6-45cb-a2b6-061f96b8256e:3610:1877696879761408:0@lo:400:kworker.0 00000100:00100000:1.0:1790711813.470084:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbf9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1877696879761920:0@lo:400:kworker.0 00000100:00100000:0.0:1790711813.470397:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbf9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879761664:0@lo:400:kworker.0 00000400:00000100:3.0:1790711813.470979:0:3610:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877696879761408 offset 0 length 224: 4 00000100:00100000:3.0:1790711813.471056:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbf9eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879762048:0@lo:400:kworker.0 00000100:00100000:3.0:1790711813.471100:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711813.471137:0:17059:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879762048 00000100:00100000:3.0:1790711813.471146:0:17059:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879762048 00000100:00100000:3.0:1790711813.471405:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790711813.471414:0:17059:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3610:x1877696879762048:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790711813.471444:0:17059:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790711813.471492:0:17059:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3610:x1877696879762048:12345-0@lo:400:kworker.0 Request processed in 77us (391us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790711813.471499:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1790711813.471574:0:3610:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790711813.471580:0:3610:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790711813.471585:0:3610:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790711813.471591:0:3610:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790711813.471595:0:3610:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1790711813.471606:0:3610:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dab81c7e800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711813.471636:0:3610:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e7b80 x1877696879762688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790711813.471655:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbf9eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879762048:0@lo:400:kworker.0 00000100:00100000:3.0:1790711813.471686:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879762560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790711813.471714:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711813.471741:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879762560 00000100:00100000:3.0:1790711813.471744:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879762560 00000100:00100000:3.0:1790711813.471793:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790711813.471799:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879762560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790711813.471834:0:18568:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790711813.471871:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879762560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711813.471878:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1790711813.471896:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790711813.471924:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879762560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790711813.472025:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711813.472076:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1877696879762688:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1790711813.472107:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711813.472139:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbf9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879761792:0@lo:400:kworker.0 00000100:00100000:2.0:1790711813.472168:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711813.472188:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879762304:0@lo:400:kworker.0 00000100:00100000:2.0:1790711813.472231:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711813.472264:0:17058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879762688 00000100:00100000:2.0:1790711813.472268:0:17058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879762688 00000100:00100000:2.0:1790711813.472289:0:17058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879762304 00000100:00100000:2.0:1790711813.472292:0:17058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879762304 00000100:00100000:2.0:1790711813.472319:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790711813.472324:0:17058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1877696879762688:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1790711813.472345:0:17058:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790711813.472389:0:17058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1877696879762688:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 63us (281us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790711813.472396:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790711813.472409:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790711813.472414:0:17058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3608:x1877696879762304:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790711813.472419:0:17058:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790711813.472446:0:17058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3608:x1877696879762304:12345-0@lo:400:kworker.0 Request processed in 30us (215us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790711813.472452:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1790711813.472480:0:3608:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790711813.472484:0:3608:0:(import.c:65:import_set_state_nolock()) ffff9dac8fdf1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790711813.472488:0:3608:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790711813.472491:0:3608:0:(import.c:65:import_set_state_nolock()) ffff9dac8fdf1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790711813.472495:0:3608:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 528 00000100:00080000:2.0:1790711813.472502:0:3608:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dac8fdf1800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1790711813.472519:0:3608:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab8329dc00 x1877696879762816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790711813.472533:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879762304:0@lo:400:kworker.0 00000100:00100000:2.0:1790711813.472572:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1877696879762816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1790711813.472596:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790711813.472616:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790711813.472621:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790711813.472625:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1877696879762688:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1790711813.472645:0:17058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879762816 00000100:00100000:2.0:1790711813.472654:0:17058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879762816 00000100:00100000:2.0:1790711813.472673:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790711813.472678:0:17058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1877696879762816:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1790711813.472689:0:17058:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790711813.472717:0:17058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1877696879762816:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 37us (120us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790711813.472723:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1790711813.472746:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dac8fdf1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790711813.472749:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790711813.472752:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1877696879762816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1790711813.473055:0:17064:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879761536 00000100:00100000:3.0:1790711813.473060:0:17064:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879761536 00000100:00100000:3.0:1790711813.473094:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790711813.473099:0:17064:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3606:x1877696879761536:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790711813.473110:0:17064:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790711813.473152:0:17064:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3606:x1877696879761536:12345-0@lo:38:kworker.0 Request processed in 51us (1127us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790711813.473158:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1790711813.473684:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacbf9b0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790711813.473690:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790711813.473694:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879761536:0@lo:38:kworker.0 00000100:00100000:0.0:1790711813.474128:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711813.474278:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1877696879762432:0@lo:400:kworker.0 00000100:00100000:0.0:1790711813.474375:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711813.474480:0:18860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879761792 00000100:00100000:0.0:1790711813.474486:0:18860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879761792 00000100:00100000:0.0:1790711813.474560:0:18860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790711813.474569:0:18860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879761792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711813.474642:0:18860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879761792:12345-0@lo:400:kworker.0 Request processed in 73us (2472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711813.474648:0:18860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790711813.474792:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711813.474817:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1877696879762176:0@lo:400:kworker.0 00000100:00100000:0.0:1790711813.474854:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711813.474958:0:18565:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879761664 00000100:00100000:1.0:1790711813.474963:0:18565:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879761664 00000100:00100000:1.0:1790711813.475006:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790711813.475014:0:18565:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879761664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711813.475068:0:18565:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879761664:12345-0@lo:400:kworker.0 Request processed in 56us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711813.475074:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1790711813.475095:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790711813.479426:0:17058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879761920 00000100:00100000:2.0:1790711813.479449:0:17058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879761920 00000100:00100000:2.0:1790711813.479529:0:17058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879762432 00000100:00100000:2.0:1790711813.479534:0:17058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879762432 00000100:00100000:2.0:1790711813.479604:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790711813.479619:0:17058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1877696879762432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711813.479755:0:17058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1877696879762432:12345-0@lo:400:kworker.0 Request processed in 141us (5379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711813.479764:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790711813.479786:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790711813.479791:0:17058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3609:x1877696879761920:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790711813.479797:0:17058:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790711813.479829:0:17058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3609:x1877696879761920:12345-0@lo:400:kworker.0 Request processed in 36us (5702us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790711813.479835:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1790711813.479875:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790711813.479930:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbf9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879761792:0@lo:400:kworker.0 00000100:00080000:2.0:1790711813.479996:0:3609:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790711813.480003:0:3609:0:(import.c:65:import_set_state_nolock()) ffff9daca089c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790711813.480008:0:3609:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790711813.480014:0:3609:0:(import.c:65:import_set_state_nolock()) ffff9daca089c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790711813.480019:0:3609:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:2.0:1790711813.480030:0:3609:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9daca089c000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1790711813.480065:0:3609:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab8329dc00 x1877696879762944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790711813.480093:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbf9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1877696879761920:0@lo:400:kworker.0 00010000:00080000:2.0:1790711813.480113:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9dab8329c380 x1877696879762432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711813.480123:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1877696879762432:0@lo:400:kworker.0 00000100:00100000:2.0:1790711813.480151:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877696879762944:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1790711813.480577:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbf9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879761664:0@lo:400:kworker.0 00000100:00100000:2.0:1790711813.480653:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711813.480694:0:17058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879762176 00000100:00100000:2.0:1790711813.480699:0:17058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879762176 00000100:00100000:2.0:1790711813.480740:0:17058:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879762944 00000100:00100000:2.0:1790711813.480743:0:17058:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879762944 00000100:00100000:2.0:1790711813.480755:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790711813.480762:0:17058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877696879762176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711813.480809:0:17058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877696879762176:12345-0@lo:400:kworker.0 Request processed in 47us (5953us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711813.480814:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790711813.480829:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790711813.480844:0:17058:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1877696879762944:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1790711813.480865:0:17058:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790711813.480898:0:17058:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1877696879762944:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 53us (244us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790711813.480904:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1790711813.480921:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790711813.480945:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca089c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790711813.480949:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790711813.480952:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877696879762944:0@lo:38:ptlrpcd_00_02.0 00010000:00080000:0.0:1790711813.481020:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9dab8329df80 x1877696879762176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711813.481031:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1877696879762176:0@lo:400:kworker.0 00010000:00010000:3.0:1790711813.922117:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711814.946737:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711815.003972:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879763072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790711815.004076:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711815.004444:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879763072 00000100:00100000:3.0:1790711815.004457:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879763072 00000100:00080000:2.0:1790711815.004814:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790711815.004889:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790711815.004906:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879763072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790711815.004951:0:18568:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790711815.005082:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879763072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 182us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711815.005090:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790711815.005889:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879763072:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1790711815.623249:0:20831:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790711815.639813:0:20831:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1790711815.639872:0:20831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15400/0xcf3cf816241e02a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e02b0 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.639888:0:20831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15400/0xcf3cf816241e02a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e02b0 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.639913:0:20831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15400/0xcf3cf816241e02a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e02b0 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.639920:0:20831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dab82d15400/0xcf3cf816241e02a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e02b0 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.639948:0:20831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790711815.639955:0:20831:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790711815.640001:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790711815.640007:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790711815.640013:0:20831:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790711815.640020:0:20831:0:(import.c:65:import_set_state_nolock()) ffff9daca089c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1790711815.640025:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790711815.640026:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790711815.640030:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790711815.640928:0:20831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5184400/0xcf3cf816241e0208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e020f expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.640942:0:20831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5184400/0xcf3cf816241e0208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e020f expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.640949:0:20831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5184400/0xcf3cf816241e0208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e020f expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.640955:0:20831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dacb5184400/0xcf3cf816241e0208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e020f expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.640974:0:20831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790711815.640990:0:20831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167ca00/0xcf3cf816241e04f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e04fc expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.640997:0:20831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167ca00/0xcf3cf816241e04f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e04fc expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.641002:0:20831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167ca00/0xcf3cf816241e04f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e04fc expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.641008:0:20831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dac8167ca00/0xcf3cf816241e04f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e04fc expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.641015:0:20831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1790711815.641021:0:20831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d13400/0xcf3cf816241e0692 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0699 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.641027:0:20831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d13400/0xcf3cf816241e0692 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0699 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.641032:0:20831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d13400/0xcf3cf816241e0692 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e0699 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.641038:0:20831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dab82d13400/0xcf3cf816241e0692 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e0699 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.641044:0:20831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1790711815.641048:0:20831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15c00/0xcf3cf816241e01fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0201 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.641055:0:20831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15c00/0xcf3cf816241e01fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0201 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.641068:0:20831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15c00/0xcf3cf816241e01fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e0201 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.641074:0:20831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dab82d15c00/0xcf3cf816241e01fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e0201 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711815.641081:0:20831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1790711815.641084:0:20831:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1790711815.641111:0:20831:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1790711815.641116:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1790711815.641120:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790711815.641126:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1790711815.641133:0:20831:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9dab84247800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790711815.641138:0:20831:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9dab8209f000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790711815.641142:0:20831:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9dab833999c0) has exports, disconnecting them 00000020:00080000:3.0:1790711815.641146:0:20831:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dab84247800), last request at 1790711813 00000020:00000080:3.0:1790711815.641153:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e04e7 00000100:00080000:3.0:1790711815.641173:0:20831:0:(import.c:65:import_set_state_nolock()) ffff9dab84245800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790711815.641235:0:20831:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dab84247800): rc 0 00000020:00000080:3.0:1790711815.641237:0:20831:0:(genops.c:885:class_export_put()) final put ffff9dab84247800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1790711815.641257:0:20831:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9dab8209f000), last request at 1790711813 00000020:00000080:3.0:1790711815.641260:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0389 00000100:00080000:3.0:1790711815.641265:0:20831:0:(import.c:65:import_set_state_nolock()) ffff9dab82099800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790711815.641271:0:20831:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dab8209f000): rc 0 00000020:00000080:3.0:1790711815.641272:0:20831:0:(genops.c:885:class_export_put()) final put ffff9dab8209f000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1790711815.641279:0:20831:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb22b41573ae0 00000100:00080000:3.0:1790711815.641296:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790711815.641310:0:20831:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9dab83bb7800 x1877696879761152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790711826 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711815.641325:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1790711815.642153:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879761152:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1790711815.642182:0:20831:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790711815.642197:0:20831:0:(import.c:65:import_set_state_nolock()) ffff9dacbf9b0000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1790711815.642281:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790711815.642291:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dab82d15400/0xcf3cf816241e02a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e02b0 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790711815.642297:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84247800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:0.0:1790711815.642302:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d15400 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711815.642308:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d15400/0xcf3cf816241e02a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e02b0 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642319:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dab82d15400/0xcf3cf816241e02a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e02b0 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711815.642327:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d15400/0xcf3cf816241e02a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e02b0 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711815.642333:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790711815.642336:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790711815.642339:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790711815.642372:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dab82d15400/0xcf3cf816241e02a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e02b0 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642378:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711815.642402:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dab82d15400/0xcf3cf816241e02a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e02b0 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642422:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dab82d15400/0xcf3cf816241e02a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e02b0 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1790711815.642434:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab8209f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00010000:00010000:0.0:1790711815.642437:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790711815.642442:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dacb5184400/0xcf3cf816241e0208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e020f expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642449:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184400 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711815.642453:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dacb5184400/0xcf3cf816241e0208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e020f expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642461:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dacb5184400/0xcf3cf816241e0208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e020f expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711815.642468:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dacb5184400/0xcf3cf816241e0208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e020f expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711815.642474:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00000080:1.0:1790711815.642477:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab84245800 for lustre-MDT0001 10000000:01000000:0.0:1790711815.642477:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1790711815.642480:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000020:00000080:1.0:1790711815.642486:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab82099800 for lustre-MDT0001 00010000:00010000:0.0:1790711815.642497:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dacb5184400/0xcf3cf816241e0208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e020f expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642504:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711815.642533:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dacb5184400/0xcf3cf816241e0208 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e020f expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642561:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dacb5184400/0xcf3cf816241e0208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e020f expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642583:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790711815.642587:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac8167ca00/0xcf3cf816241e04f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e04fc expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642592:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167ca00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711815.642595:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167ca00/0xcf3cf816241e04f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e04fc expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642602:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac8167ca00/0xcf3cf816241e04f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e04fc expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711815.642609:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167ca00/0xcf3cf816241e04f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e04fc expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711815.642614:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790711815.642616:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1790711815.642618:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1790711815.642632:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790711815.642634:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dac8167ca00/0xcf3cf816241e04f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e04fc expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642642:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711815.642650:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac8167ca00/0xcf3cf816241e04f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e04fc expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642657:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac8167ca00/0xcf3cf816241e04f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e04fc expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642670:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711815.642674:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dab82d15c00/0xcf3cf816241e01fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e0201 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642685:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d15c00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711815.642688:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d15c00/0xcf3cf816241e01fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e0201 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642694:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dab82d15c00/0xcf3cf816241e01fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e0201 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711815.642701:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d15c00/0xcf3cf816241e01fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e0201 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711815.642706:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790711815.642708:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790711815.642710:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790711815.642722:0:17046:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dab82d15c00/0xcf3cf816241e01fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e0201 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642728:0:17046:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711815.642734:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dab82d15c00/0xcf3cf816241e01fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e0201 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642741:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dab82d15c00/0xcf3cf816241e01fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e0201 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711815.642752:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711815.642754:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711815.642756:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711815.642835:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879763200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790711815.642858:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1803113-c9d6-45cb-a2b6-061f96b8256e:3609:1877696879763328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711815.642905:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711815.642966:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790711815.642978:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879763200 00000100:00100000:0.0:1790711815.642981:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879763584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790711815.642986:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879763200 00000100:00100000:0.0:1790711815.643011:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790711815.645420:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711815.645433:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dab82d13400/0xcf3cf816241e0692 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e0699 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711815.645443:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d13400 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:2.0:1790711815.645448:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d13400/0xcf3cf816241e0692 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e0699 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711815.645458:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dab82d13400/0xcf3cf816241e0692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e0699 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790711815.645512:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d13400/0xcf3cf816241e0692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e0699 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711815.645605:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790711815.645609:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790711815.645612:0:17047:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790711815.645647:0:17047:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dab82d13400/0xcf3cf816241e0692 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e0699 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711815.645654:0:17047:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790711815.645841:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dab82d13400/0xcf3cf816241e0692 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e0699 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711815.645851:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dab82d13400/0xcf3cf816241e0692 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3cf816241e0699 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711815.645867:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711815.645869:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711815.645872:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711815.645878:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711815.645880:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711815.645958:0:17043:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879763584 00000100:00100000:1.0:1790711815.645966:0:17043:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879763584 00000100:00100000:0.0:1790711815.645984:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879763712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790711815.645998:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790711815.646005:0:17043:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3608:x1877696879763200:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790711815.646012:0:17043:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790711815 with bad export cookie 14933083238432637140 00000100:00100000:0.0:1790711815.646039:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711815.646070:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711815.646096:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790711815.646103:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1803113-c9d6-45cb-a2b6-061f96b8256e:3609:1877696879763456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711815.646128:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711815.646269:0:17044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879763712 00000100:00100000:2.0:1790711815.646274:0:17044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879763712 00000100:00100000:2.0:1790711815.646292:0:17044:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1790711815.646300:0:17044:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1790711815.646958:0:17044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879763328 00000100:00100000:0.0:1790711815.646964:0:17044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879763328 00000100:00100000:0.0:1790711815.646987:0:17044:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790711815.646993:0:17044:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879763456 00000100:00100000:0.0:1790711815.646996:0:17044:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879763456 00000100:00080000:3.0:1790711815.647011:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790711815.647017:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1790711815.647037:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790711815.647117:0:20833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790711815.647123:0:20833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3608:x1877696879763584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790711815.647128:0:20833:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790711815 with bad export cookie 14933083238432637140 00000100:00100000:2.0:1790711815.647184:0:20833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3608:x1877696879763584:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (4172us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790711815.647203:0:20833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790711815.647220:0:20833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790711815.647233:0:20833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3608:x1877696879763712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790711815.647238:0:20833:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790711815 with bad export cookie 14933083238432637140 00000100:00100000:2.0:1790711815.647267:0:20833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3608:x1877696879763712:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (1230us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790711815.647273:0:20833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790711815.647287:0:20833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790711815.647291:0:20833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3609:x1877696879763328:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790711815.647295:0:20833:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790711815 with bad export cookie 14933083238432637140 00000100:00100000:2.0:1790711815.647325:0:20833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3609:x1877696879763328:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (1254us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790711815.647331:0:20833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790711815.647457:0:20833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790711815.647463:0:20833:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dac894ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3609:x1877696879763456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790711815.647476:0:20833:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790711815 with bad export cookie 14933083238432637140 00000100:00100000:2.0:1790711815.647504:0:20833:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dac894ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3609:x1877696879763456:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (1375us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790711815.647509:0:20833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1790711815.647898:0:3609:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790711815.647903:0:3609:0:(import.c:65:import_set_state_nolock()) ffff9dab84213800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1790711815.647907:0:3609:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1790711815.648170:0:20831:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1790711815.648205:0:20831:0:(import.c:65:import_set_state_nolock()) ffff9dab83bad000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1790711815.648231:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790711815.648235:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1790711815.648271:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1790711815.648362:0:20831:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1790711815.648373:0:20831:0:(import.c:65:import_set_state_nolock()) ffff9daca0101000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1790711815.648413:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9dab833999c0) has no exports 00000100:00100000:2.0:1790711815.648471:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879763840:0@lo:9:umount.0 00000100:00100000:2.0:1790711815.648518:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711815.648576:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879763968:0@lo:9:umount.0 00000100:00100000:2.0:1790711815.648598:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711815.648675:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879763840 00000100:00100000:3.0:1790711815.648681:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879763840 00000100:00100000:3.0:1790711815.648716:0:19653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879763968 00000100:00100000:3.0:1790711815.648719:0:19653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879763968 00000100:00100000:3.0:1790711815.648791:0:19653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790711815.648800:0:19653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1877696879763840:12345-0@lo:9:umount.0 00000100:00100000:2.0:1790711815.648847:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000020:00000080:3.0:1790711815.648890:0:19653:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e03b3 00000100:00100000:2.0:1790711815.648899:0:18566:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877696879763968:12345-0@lo:9:umount.0 00000100:00080000:3.0:1790711815.648921:0:19653:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7b000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1790711815.648936:0:18566:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0518 00000100:00080000:2.0:1790711815.648964:0:18566:0:(import.c:65:import_set_state_nolock()) ffff9dab84240800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790711815.649075:0:18566:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1790711815.649224:0:18566:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3606:x1877696879763968:12345-0@lo:9:umount.0 Request processed in 346us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711815.649232:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1790711815.649251:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790711815.649273:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca0101000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790711815.649281:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790711815.649283:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790711815.649310:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879763968:0@lo:9:umount.0 00000001:00000004:3.0:1790711815.649351:0:19653:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1790711815.649669:0:19653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3606:x1877696879763840:12345-0@lo:9:umount.0 Request processed in 870us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711815.649689:0:19653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1790711815.649707:0:17054:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790711815.649731:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab83bad000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790711815.649740:0:3606:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790711815.649742:0:3606:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790711815.649745:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879763840:0@lo:9:umount.0 00010000:00010000:2.0:1790711815.658618:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790711815.658670:0:3608:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1790711815.662524:0:17043:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3608:x1877696879763200:12345-0@lo:103:ldlm_bl.0 Request processed in 16512us (19614us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790711815.662536:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000001:00100000:3.0:1790711815.663442:0:18561:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790711815.663448:0:18561:0:(genops.c:885:class_export_put()) final put ffff9dab81c7d000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1790711815.663474:0:18561:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790711815.663476:0:18561:0:(genops.c:885:class_export_put()) final put ffff9dab82e89000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790711815.666956:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab81c7d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790711815.667013:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab82e89000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1790711815.667029:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab81c7b000 for lustre-OST0000 00000020:00000080:1.0:1790711815.667033:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab82e89800 for lustre-OST0000 00000100:00080000:0.0:1790711815.695704:0:3609:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.106@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1790711815.695709:0:3609:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790711815.695719:0:3609:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dacbc44a680 x1877696879761408/t0(0) o400->MGC192.168.203.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790711829 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711815.695745:0:3609:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab83bb7800 x1877696879763200/t0(0) o103->MGC192.168.203.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790711831 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711815.695754:0:3609:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab83bb6d80 x1877696879763328/t0(0) o103->MGC192.168.203.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790711831 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711815.695764:0:3609:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab83bb5f80 x1877696879763584/t0(0) o103->MGC192.168.203.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790711831 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711815.695773:0:3609:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab8329e300 x1877696879763712/t0(0) o103->MGC192.168.203.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790711831 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711815.695806:0:3609:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab83bb7b80 x1877696879763456/t0(0) o103->MGC192.168.203.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790711831 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790711815.696434:0:3608:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9dab84213800 already not connected (conn 1, was 1): DISCONN 10000000:01000000:0.0:1790711815.696478:0:3609:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790711815.696482:0:3609:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790711815.696484:0:3609:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790711815.696487:0:3609:0:(import.c:65:import_set_state_nolock()) ffff9dab84213800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790711815.696492:0:3609:0:(import.c:545:import_select_connection()) MGC192.168.203.106@tcp: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1790711815.696506:0:3609:0:(import.c:666:import_select_connection()) MGC192.168.203.106@tcp: import ffff9dab84213800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1790711815.696618:0:3609:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51d4e00 x1877696879764096/t0(0) o250->MGC192.168.203.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790711815.696661:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1803113-c9d6-45cb-a2b6-061f96b8256e:3609:1877696879763328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790711815.696688:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e1803113-c9d6-45cb-a2b6-061f96b8256e:3609:1877696879763456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790711815.696746:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e1803113-c9d6-45cb-a2b6-061f96b8256e:3606:1877696879764096:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1790711815.696795:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877696879764096 offset 0 length 520: 4 00000100:00100000:3.0:1790711815.696971:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e1803113-c9d6-45cb-a2b6-061f96b8256e:3610:1877696879761408:0@lo:400:kworker.0 00000100:00100000:3.0:1790711815.697023:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879763584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790711815.697030:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879763200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790711815.697041:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e1803113-c9d6-45cb-a2b6-061f96b8256e:3608:1877696879763712:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1790711815.706174:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9dab833999c0) has no exports 00000020:01000000:0.0:1790711815.751674:0:20831:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9dac98882d80 - data ffff9dac98f0d5e8/ffff9dacae56d800 00000020:01000000:0.0:1790711815.751823:0:20831:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9dab81085cc0 - data ffff9dac85d545e8/ffff9dacafd3c400 00000001:00000004:0.0:1790711815.767083:0:20831:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1790711815.822808:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790711815.822818:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790711815.822826:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1790711815.828708:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790711815.828717:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1790711815.828782:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790711815.828786:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790711815.829667:0:17798:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790711815.829673:0:17798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1790711815.829684:0:17798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1790711815.830264:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790711815.830269:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1790711815.830286:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790711815.830288:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790711815.830669:0:17800:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790711815.830674:0:17800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1790711815.830682:0:17800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1790711815.839139:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e021d 00000020:00000080:2.0:1790711815.839155:0:20831:0:(genops.c:885:class_export_put()) final put ffff9daca089f800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790711815.841457:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0232 00000020:00000080:2.0:1790711815.841469:0:20831:0:(genops.c:885:class_export_put()) final put ffff9dab833a6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790711815.844072:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca089f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1790711815.847146:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1790711815.847161:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790711815.847171:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790711815.847176:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9dab8339b380) has no exports 00000004:01000000:2.0:1790711815.847398:0:20831:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1790711815.847410:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0286 00000020:00000080:2.0:1790711815.847417:0:20831:0:(genops.c:885:class_export_put()) final put ffff9daca0106000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790711815.847423:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1790711815.847427:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790711815.847434:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790711815.847437:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9dacb13199c0) has no exports 00000020:00000080:2.0:1790711815.847444:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e027f 00000020:00000080:2.0:1790711815.847449:0:20831:0:(genops.c:885:class_export_put()) final put ffff9daca0106800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1790711815.848049:0:20831:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1790711815.848054:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790711815.848058:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1790711815.848064:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790711815.848066:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790711815.848094:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790711815.848100:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790711815.848105:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0271 00000020:00000080:2.0:1790711815.848109:0:20831:0:(genops.c:885:class_export_put()) final put ffff9daca0102800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790711815.848113:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1790711815.848118:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790711815.848120:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790711815.848123:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9dacaed5cd40) has no exports 00000020:00000080:2.0:1790711815.848127:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0263 00000020:00000080:2.0:1790711815.848131:0:20831:0:(genops.c:885:class_export_put()) final put ffff9dacb13be000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1790711815.848805:0:20831:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1790711815.848809:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790711815.848811:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1790711815.848816:0:20831:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790711815.848828:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790711815.848855:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790711815.848860:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1790711815.848869:0:20831:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1790711815.848874:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0255 00000020:00000080:2.0:1790711815.848878:0:20831:0:(genops.c:885:class_export_put()) final put ffff9dacb13bb000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790711815.848882:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1790711815.848885:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790711815.848889:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790711815.848891:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9dab82d50000) has no exports 00000020:00000080:2.0:1790711815.848895:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e024e 00000020:00000080:2.0:1790711815.848897:0:20831:0:(genops.c:885:class_export_put()) final put ffff9dacbf9b6000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1790711815.849355:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab833a6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1790711815.849364:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca0106000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790711815.849368:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca0106800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790711815.849374:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9daca0101000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1790711815.849379:0:36:0:(genops.c:885:class_export_put()) final put ffff9daca0101800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790711815.849381:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca0101800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1790711815.849385:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790711815.849464:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca0102800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1790711815.849470:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacb13be000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1790711815.849474:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab83bad000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1790711815.849478:0:36:0:(genops.c:885:class_export_put()) final put ffff9dacb13ba000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790711815.853587:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacb13ba000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1790711815.853598:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790711815.853688:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacb13bb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1790711815.853693:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbf9b6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1790711815.855856:0:20831:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1790711815.855864:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790711815.855868:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790711815.855875:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790711815.855929:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790711815.855950:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790711815.855977:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790711815.855980:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790711815.855985:0:20831:0:(genops.c:885:class_export_put()) final put ffff9daca0898800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790711815.855989:0:20831:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca0898800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1790711815.856001:0:20831:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790711815.856148:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0239 00000020:00000080:3.0:1790711815.856154:0:20831:0:(genops.c:885:class_export_put()) final put ffff9dab833a7000/lustre-MDD0001_UUID 00000020:01000000:3.0:1790711815.856159:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1790711815.856162:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790711815.856168:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790711815.856171:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9dab8339cd40) has no exports 00000020:00000080:3.0:1790711815.856367:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790711815.856372:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1790711815.856377:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0240 00000020:00000080:3.0:1790711815.856382:0:20831:0:(genops.c:885:class_export_put()) final put ffff9dab833a0800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1790711815.856403:0:20831:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dacbfa31000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1790711815.856407:0:20831:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dacbfa31000 2 00000020:01000004:3.0:1790711815.856410:0:20831:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dacbfa31000 from lustre-MDT0001 00000020:00000080:3.0:1790711815.856427:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790711815.856431:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1790711815.856434:0:20831:0:(genops.c:885:class_export_put()) final put ffff9daca089d800/lustre-MDT0001_UUID 00000020:00000080:3.0:1790711815.856436:0:20831:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca089d800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1790711815.856443:0:20831:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1790711815.856475:0:20831:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1790711815.856479:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1790711815.856482:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790711815.856485:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790711815.856491:0:20831:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9daca0104800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790711815.856496:0:20831:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9dab82d53380) has exports, disconnecting them 00000020:00080000:3.0:1790711815.856501:0:20831:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9daca0104800), last request at 1790711723 00000020:00000080:3.0:1790711815.856504:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e02be 00000020:00080000:3.0:1790711815.856517:0:20831:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9daca0104800): rc 0 00000020:00000080:3.0:1790711815.856520:0:20831:0:(genops.c:885:class_export_put()) final put ffff9daca0104800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1790711815.857663:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dacbf9b0000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790711815.857676:0:36:0:(genops.c:885:class_export_put()) final put ffff9dacbf9b2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790711815.857678:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbf9b2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1790711815.857690:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790711815.857816:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab833a7000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1790711815.857821:0:36:0:(genops.c:885:class_export_put()) final put ffff9dab833a1000/lustre-MDD0001_UUID 00000020:00000080:0.0:1790711815.857823:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab833a1000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1790711815.857827:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1790711815.857934:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab833a0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790711815.857939:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca0104800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1790711815.858616:0:20831:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1790711815.858621:0:20831:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790711815.858624:0:20831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790711815.858639:0:20831:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790711815.858665:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9daca089c000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1790711815.858841:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790711815.858849:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1790711815.858853:0:20831:0:(genops.c:885:class_export_put()) final put ffff9daca0899000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1790711815.858856:0:20831:0:(genops.c:844:class_export_destroy()) destroying export ffff9daca0899000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1790711815.858861:0:20831:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1790711815.858905:0:20831:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dacbfa31000 1 00000020:00000080:0.0:1790711815.858911:0:20831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e01e5 00000020:00000080:0.0:1790711815.858917:0:20831:0:(genops.c:885:class_export_put()) final put ffff9dacb13b8800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1790711815.858925:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1790711815.858933:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacb13b8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790711815.858953:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790711815.858958:0:20831:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790711815.858962:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9daca0a219c0) has no exports 00000020:00000080:0.0:1790711815.911257:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790711815.911271:0:20831:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1790711815.911277:0:20831:0:(genops.c:885:class_export_put()) final put ffff9dacb4671000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790711815.911282:0:20831:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacb4671000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1790711815.911293:0:20831:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1790711815.911565:0:20831:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dacb4674000 00000020:01000000:0.0:1790711815.911584:0:20831:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1790711815.911589:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790711815.911592:0:20831:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790711815.911596:0:20831:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9dacb52db380) has no exports 00000100:00100000:0.0:1790711815.911729:0:17059:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff9dab82f4e000:17059] 1 exiting: rc = 0 00000100:00100000:2.0:1790711815.912255:0:17058:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff9dab82f4e800:17058] 0 exiting: rc = 1 00000100:00100000:3.0:1790711815.912758:0:19887:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff9dab83087a00:19887] 3 exiting: rc = 0 00000100:00100000:3.0:1790711815.913103:0:17060:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff9dab82f4f400:17060] 2 exiting: rc = 0 00000100:00100000:0.0:1790711815.913844:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913852:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913859:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913864:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913870:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913888:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913893:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913899:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913903:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913909:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913916:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913922:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913928:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913934:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913939:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913945:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913950:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913955:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913961:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913966:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913971:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913976:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913981:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913986:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913991:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.913997:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914002:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914008:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914014:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914020:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914025:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914031:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914037:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914042:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914048:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914054:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914059:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914064:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914070:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914075:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914090:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914096:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914102:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914108:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914113:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914119:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914125:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914131:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914136:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914141:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914148:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914155:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914160:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914166:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914171:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914177:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914182:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914200:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914206:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914212:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914217:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914222:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914229:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.914235:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790711815.916941:0:17061:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9dab82f4ec00:17061] 0 exiting: rc = 1 00000100:00100000:2.0:1790711815.917557:0:17062:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9dab82f4f800:17062] 1 exiting: rc = 0 00000100:00100000:0.0:1790711815.918082:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918092:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918098:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918103:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918109:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918114:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918122:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918134:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918141:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918146:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918153:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918173:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918178:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918182:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918196:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918202:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918207:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918212:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918217:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918222:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918229:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918234:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918240:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918246:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918251:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918255:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918260:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918265:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918270:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918274:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918279:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918284:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918288:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918293:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918298:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918303:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918308:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918313:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918319:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918324:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918330:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918334:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918339:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918344:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918349:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918354:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918368:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918373:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918378:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918383:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918387:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918392:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918397:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918402:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918407:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918412:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918423:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918429:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918434:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918440:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918449:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918455:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918462:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.918467:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790711815.921808:0:17064:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff9dab81cc6800:17064] 1 exiting: rc = 0 00000100:00100000:2.0:1790711815.921809:0:18075:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff9dacbcb5bc00:18075] 2 exiting: rc = 0 00000100:00100000:2.0:1790711815.921924:0:17063:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff9dacb50d2e00:17063] 0 exiting: rc = 1 00000100:00100000:0.0:1790711815.922034:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922062:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922082:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922092:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922098:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922103:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922108:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922115:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922120:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922127:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922133:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922155:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922165:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922173:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922181:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922199:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922207:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922227:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922236:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922244:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922253:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922261:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922269:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922293:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922302:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922309:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922317:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922323:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922329:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922336:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922344:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922351:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922358:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922365:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922374:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922404:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922415:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922424:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922436:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922443:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922450:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922457:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922463:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922470:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922476:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922481:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922487:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922507:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922513:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922519:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922525:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922530:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922564:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922571:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922578:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922586:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922593:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922599:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922605:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922628:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922636:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922644:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922651:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711815.922671:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790711815.936414:0:17066:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9dab810c5c00:17066] 1 exiting: rc = 0 00000100:00100000:0.0:1790711815.936739:0:17065:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9dab810c4800:17065] 0 exiting: rc = 1 00000100:00100000:2.0:1790711815.936818:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936825:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936830:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936835:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936840:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936847:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936852:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936857:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936861:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936866:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936871:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936876:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936881:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936886:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936891:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936895:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936900:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936905:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936925:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936930:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936935:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936941:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936947:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936952:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936957:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936962:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936968:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936973:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936978:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936983:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936987:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936993:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.936998:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937003:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937008:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937012:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937018:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937022:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937027:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937032:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937036:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937040:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937046:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937050:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937055:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937059:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937064:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937069:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937074:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937079:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937083:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937088:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937092:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937105:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937111:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937115:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937120:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937125:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937130:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937135:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937141:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937145:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937150:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.937155:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790711815.937490:0:17067:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9dacb46b0600:17067] 0 exiting: rc = 1 00000100:00100000:0.0:1790711815.938141:0:17068:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9dab83240800:17068] 1 exiting: rc = 0 00000100:00100000:2.0:1790711815.938230:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938237:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938242:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938247:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938253:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938258:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938262:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938266:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938282:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938287:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938292:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938298:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938303:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938308:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938312:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938317:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938323:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938328:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938333:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938339:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938344:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938349:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938354:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938358:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938373:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938378:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938383:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938388:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938393:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938398:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938403:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938407:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938412:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938417:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938422:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938427:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938432:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938437:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938442:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938448:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938453:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938458:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938462:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938467:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938472:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938478:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938483:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938488:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938493:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938497:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938502:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938508:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938513:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938518:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938523:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938527:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938533:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938599:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938607:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938619:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938624:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938628:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938633:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.938638:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790711815.942637:0:17069:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff9dacb46b1c00:17069] 0 exiting: rc = 1 00000100:00100000:0.0:1790711815.942707:0:17070:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff9dab83240a00:17070] 1 exiting: rc = 0 00000100:00100000:2.0:1790711815.942780:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942787:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942793:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942797:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942802:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942806:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942811:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942816:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942821:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942826:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942831:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942836:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942841:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942847:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942852:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942857:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942862:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942873:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942880:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942885:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942890:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942895:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942901:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942906:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942910:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942915:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942920:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942925:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942929:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942935:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942954:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942959:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942969:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942974:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942979:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942984:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942989:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.942994:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943000:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943005:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943011:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943015:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943020:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943025:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943031:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943043:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943049:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943053:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943059:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943063:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943069:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943073:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943078:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943083:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943094:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943100:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943105:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943115:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943124:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943132:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943136:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943143:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943148:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943153:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.943692:0:17073:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff9daca010de00:17073] 2 exiting: rc = 0 00000100:00100000:0.0:1790711815.943812:0:17071:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff9dacb50d1800:17071] 0 exiting: rc = 1 00000100:00100000:3.0:1790711815.944034:0:17072:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff9dacb4699800:17072] 1 exiting: rc = 0 00000100:00100000:2.0:1790711815.944217:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944223:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944229:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944233:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944238:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944243:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944248:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944253:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944258:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944264:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944269:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944284:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944289:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944294:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944299:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944304:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944309:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944313:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944333:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944339:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944344:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944349:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944354:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944359:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944371:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944379:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944384:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944389:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944394:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944399:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944432:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944438:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944443:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944448:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944453:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944466:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944471:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944475:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944480:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944485:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944490:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.944496:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945080:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945089:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945094:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945099:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945104:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945110:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945115:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945120:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945126:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945132:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945138:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945145:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945151:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945158:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945163:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945170:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945176:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945182:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945196:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945202:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945207:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711815.945212:0:20831:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790711815.952009:0:20831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790711815.952021:0:20831:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1790711815.952027:0:20831:0:(genops.c:885:class_export_put()) final put ffff9dab84217000/MDS_uuid 00000020:00000080:2.0:1790711815.952032:0:20831:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84217000/MDS_uuid for MDS 00000020:01000000:2.0:1790711815.952037:0:20831:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1790711815.952452:0:20831:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1790711816.002661:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711817.051021:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711818.075917:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790711818.586928:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790711818.586939:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790711818.586942:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790711818.586945:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790711818.586949:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790711818.586957:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 579 00000100:00080000:2.0:1790711818.586963:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790711818.586977:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dab81c7e800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1790711818.587018:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab8329ce00 x1877696879764224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790711818.587127:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879764352:0@lo:400:kworker.0 00000400:00000100:0.0:1790711818.587187:0:3609:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879764352 offset 0 length 224: 4 00000100:00080000:2.0:1790711818.587242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790711818.587246:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790711818.587248:0:36:0:(import.c:65:import_set_state_nolock()) ffff9dac8fdf1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790711818.587252:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 579 00000100:00080000:2.0:1790711818.587255:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790711818.587261:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dac8fdf1800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1790711818.587276:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab8329d180 x1877696879764480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790711818.587375:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1877696879764224:0@lo:38:kworker.0 00000400:00000100:3.0:1790711818.587401:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879764224 offset 0 length 520: 4 00000100:00100000:3.0:1790711818.587434:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1877696879764480:0@lo:38:kworker.0 00000400:00000100:3.0:1790711818.587452:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879764480 offset 0 length 520: 4 00000100:00100000:3.0:1790711818.587482:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1877696879764608:0@lo:400:kworker.0 00000400:00000100:3.0:1790711818.587499:0:3610:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879764608 offset 0 length 224: 4 00010000:00010000:3.0:1790711819.100369:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711820.131812:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790711820.418408:0:21034:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790711820.431944:0:21034:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1790711820.432020:0:21034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e035f expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711820.432048:0:21034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e035f expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711820.432057:0:21034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e035f expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711820.432065:0:21034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e035f expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711820.433717:0:21034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790711820.433737:0:21034:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790711820.435328:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790711820.435349:0:21034:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab8329ce00 x1877696879764224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790711833 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711820.435375:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790711820.435382:0:21034:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790711820.435389:0:21034:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790711820.435396:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790711820.435400:0:21034:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab8329ce00 x1877696879764224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790711833 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711820.435408:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790711820.435411:0:21034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1790711820.436638:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1877696879764224:0@lo:38:kworker.0 00010000:00010000:3.0:1790711820.437916:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790711820.437932:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e035f expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711820.437946:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d12200 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:3.0:1790711820.437951:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e035f expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711820.437963:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e035f expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790711820.437971:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e035f expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790711820.437977:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790711820.437980:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790711820.437984:0:17046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790711820.438008:0:17046:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dab84213800 00010000:00010000:3.0:1790711820.438012:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0358 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e035f expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711820.438018:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0358 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e035f expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790711820.439536:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790711820.439596:0:21034:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab8329ea00 x1877696879764352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711834 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711820.439627:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790711820.439634:0:21034:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790711820.439666:0:21034:0:(import.c:65:import_set_state_nolock()) ffff9dac86068800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1790711820.439723:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711820.439727:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711820.439729:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711820.439852:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879764352:0@lo:400:kworker.0 00000100:00100000:2.0:1790711820.440377:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3606:1877696879764736:0@lo:39:umount.0 00000400:00000100:2.0:1790711820.440443:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879764736 offset 0 length 224: 4 00000100:00080000:2.0:1790711820.635318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790711820.635367:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790711820.635370:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790711820.635374:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790711820.635494:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1877696879764864:0@lo:400:kworker.0 00000400:00000100:0.0:1790711820.635726:0:3607:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879764864 offset 0 length 224: 4 00010000:00010000:3.0:1790711821.147731:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790711821.667567:0:19380:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790711821.667581:0:19380:0:(genops.c:885:class_export_put()) final put ffff9dab84246800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1790711821.667731:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84246800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1790711821.667807:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab84240800 for lustre-OST0001 00010000:00010000:3.0:1790711822.171000:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711823.194734:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790711823.642811:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790711823.642822:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790711823.642825:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790711823.642847:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790711823.643030:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879764992:0@lo:400:kworker.0 00000400:00000100:0.0:1790711823.643114:0:3608:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879764992 offset 0 length 224: 4 00010000:00010000:3.0:1790711824.219425:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711825.245482:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711825.562736:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711815/real 1790711815] req@ffff9dacb51d4e00 x1877696879764096/t0(0) o250->MGC192.168.203.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790711825 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711825.562777:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dacb51d4e00 x1877696879764096/t0(0) o250->MGC192.168.203.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790711825 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790711825.562805:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab84213800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790711825.562834:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1790711825.563145:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e1803113-c9d6-45cb-a2b6-061f96b8256e:3606:1877696879764096:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1790711825.568380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790711825.568396:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1790711825.568401:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dab84213800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790711825.568413:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.106@tcp: connect to NID 0@lo last attempt 581 00000100:00080000:3.0:1790711825.568421:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.106@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790711825.568440:0:8:0:(import.c:666:import_select_connection()) MGC192.168.203.106@tcp: import ffff9dab84213800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711825.568492:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e5f80 x1877696879765120/t0(0) o250->MGC192.168.203.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790711825.568534:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790711825.568592:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790711825.568661:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790711825.568682:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1877696879765248:0@lo:400:kworker.0 00000400:00000100:3.0:1790711825.568761:0:3610:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879765248 offset 0 length 224: 4 00000100:00100000:2.0:1790711825.569295:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e1803113-c9d6-45cb-a2b6-061f96b8256e:3606:1877696879765120:0@lo:250:kworker.0 00000400:00000100:2.0:1790711825.569331:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877696879765120 offset 0 length 520: 4 00010000:00010000:1.0:1790711826.266919:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711827.292291:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711828.316126:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711829.339117:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711830.362907:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711830.682810:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711820/real 1790711820] req@ffff9dacb51d4000 x1877696879764736/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790711830 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711830.682858:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dacb51d4000 x1877696879764736/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790711830 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790711830.682893:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dac86068800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790711830.682917:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3606:1877696879764736:0@lo:39:umount.0 00000100:00080000:1.0:1790711830.683148:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790711830.683165:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790711830.683171:0:21034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790711830.684724:0:21034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac994ede00/0xcf3cf816241e032e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0335 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711830.684747:0:21034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac994ede00/0xcf3cf816241e032e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0335 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711830.684755:0:21034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac994ede00/0xcf3cf816241e032e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e0335 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711830.684763:0:21034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dac994ede00/0xcf3cf816241e032e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e0335 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711830.684886:0:21034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790711830.684898:0:21034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7400/0xcf3cf816241e0684 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e068b expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711830.684906:0:21034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7400/0xcf3cf816241e0684 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e068b expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711830.684912:0:21034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7400/0xcf3cf816241e0684 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e068b expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711830.684919:0:21034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7400/0xcf3cf816241e0684 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e068b expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711830.687488:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790711830.687538:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac994ede00/0xcf3cf816241e032e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e0335 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711830.687568:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac994ede00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:3.0:1790711830.687574:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac994ede00/0xcf3cf816241e032e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e0335 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711830.687588:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac994ede00/0xcf3cf816241e032e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e0335 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790711830.687597:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac994ede00/0xcf3cf816241e032e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e0335 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790711830.687604:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790711830.687607:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1790711830.687627:0:17047:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dab84213800 00010000:00010000:3.0:1790711830.687632:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac994ede00/0xcf3cf816241e032e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e0335 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711830.687640:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac994ede00/0xcf3cf816241e032e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e0335 expref: -99 pid: 18560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711830.687663:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790711830.687667:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7400/0xcf3cf816241e0684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e068b expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711830.687673:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7400 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:3.0:1790711830.687675:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7400/0xcf3cf816241e0684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e068b expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711830.687683:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7400/0xcf3cf816241e0684 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e068b expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790711830.687697:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7400/0xcf3cf816241e0684 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e068b expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790711830.687702:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790711830.687704:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1790711830.687711:0:17047:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dab84213800 00010000:00010000:3.0:1790711830.687714:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7400/0xcf3cf816241e0684 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e068b expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711830.687721:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711830.687723:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711830.687725:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711830.688385:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711830.688426:0:21034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790711830.688437:0:21034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7400/0xcf3cf816241e0684 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e068b expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790711830.688454:0:21034:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1790711830.688462:0:21034:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1790711830.688465:0:21034:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1790711830.688511:0:21034:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1790711830.688527:0:21034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1790711830.688536:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790711830.688580:0:21034:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790711830.688586:0:21034:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9dacb131cd40) has no exports 00000020:00080000:1.0:1790711830.688622:0:21034:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9dacb131cd40) has no exports 00000020:01000000:1.0:1790711830.692331:0:21034:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9dab81f508a0 - data ffff9dab8197ce58/ffff9dacae593400 00000020:01000000:1.0:1790711830.693381:0:21034:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9dab840100c0 - data ffff9dac85f1ee58/ffff9dab82d0b000 00100000:10000000:1.0:1790711830.702350:0:21034:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790711830.719355:0:21034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0343 00000020:00000080:0.0:1790711830.719366:0:21034:0:(genops.c:885:class_export_put()) final put ffff9dacbc46f000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1790711830.719388:0:21034:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dacb13bc800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1790711830.719391:0:21034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dacb13bc800 2 00000020:01000004:0.0:1790711830.719394:0:21034:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dacb13bc800 from lustre-OST0000 00000020:00000080:0.0:1790711830.719418:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790711830.719428:0:21034:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1790711830.719431:0:21034:0:(genops.c:885:class_export_put()) final put ffff9dacbc46c000/lustre-OST0000_UUID 00000020:00000080:0.0:1790711830.719434:0:21034:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbc46c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1790711830.719451:0:21034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1790711830.719766:0:21034:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1790711830.719771:0:21034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1790711830.719776:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790711830.719781:0:21034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790711830.719787:0:21034:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9dab81c7f000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790711830.719793:0:21034:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9dacb0e5b380) has exports, disconnecting them 00000020:00080000:0.0:1790711830.719797:0:21034:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9dab81c7f000), last request at 1790711741 00000020:00000080:0.0:1790711830.719801:0:21034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e036d 00000020:00080000:0.0:1790711830.719810:0:21034:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dab81c7f000): rc 0 00000020:00000080:0.0:1790711830.719814:0:21034:0:(genops.c:885:class_export_put()) final put ffff9dab81c7f000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790711830.720761:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbc46f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790711830.720774:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab81c7f000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1790711830.720967:0:21034:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790711830.720973:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790711830.720977:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790711830.720982:0:21034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790711830.721219:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab81c7e800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790711830.721359:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790711830.721366:0:21034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1790711830.721370:0:21034:0:(genops.c:885:class_export_put()) final put ffff9dacbc46d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1790711830.721373:0:21034:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbc46d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1790711830.721383:0:21034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1790711830.721443:0:21034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1790711830.721447:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790711830.721451:0:21034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790711830.721466:0:21034:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9dac8606b800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790711830.721472:0:21034:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff9dacaed599c0) has exports, disconnecting them 00000020:00080000:1.0:1790711830.721476:0:21034:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9dac8606b800), last request at 1790711741 00000020:00000080:1.0:1790711830.721480:0:21034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0382 00000020:00080000:1.0:1790711830.721492:0:21034:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dac8606b800): rc 0 00000020:00000080:1.0:1790711830.721496:0:21034:0:(genops.c:885:class_export_put()) final put ffff9dac8606b800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1790711830.722975:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dac8606b800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1790711830.743128:0:21034:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790711830.743139:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790711830.743144:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790711830.743152:0:21034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790711830.743480:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790711830.743489:0:21034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1790711830.743496:0:21034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dacb13bc800 1 00000020:00000080:0.0:1790711830.743514:0:21034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0320 00000020:00000080:0.0:1790711830.743523:0:21034:0:(genops.c:885:class_export_put()) final put ffff9dac87ff9800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1790711830.743756:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dac86068800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1790711830.743765:0:8:0:(genops.c:885:class_export_put()) final put ffff9dac8606b000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1790711830.743767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dac8606b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1790711830.743780:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000000:0.0:1790711830.744152:0:21034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1790711830.744158:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790711830.744163:0:21034:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790711830.744168:0:21034:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff9dacb1318000) has no exports 00000020:00000080:3.0:1790711830.744290:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dac87ff9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790711830.790449:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790711830.790462:0:21034:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1790711830.790467:0:21034:0:(genops.c:885:class_export_put()) final put ffff9dacb13b9800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1790711830.790472:0:21034:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacb13b9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1790711830.790484:0:21034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1790711830.790894:0:21034:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dacb13ba800 00000020:02000400:0.0:1790711830.790966:0:21034:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1790711830.874628:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790711830.874639:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711830.874642:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790711830.874646:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790711830.874847:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790711830.874873:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1877696879765376:0@lo:400:kworker.0 00000400:00000100:2.0:1790711830.874930:0:3609:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879765376 offset 0 length 224: 4 00010000:00010000:3.0:1790711831.390567:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711832.412653:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711833.435689:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711833.756353:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711818/real 1790711818] req@ffff9dab8329d180 x1877696879764480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790711833 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711833.756389:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dab8329d180 x1877696879764480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790711833 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790711833.756412:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dac8fdf1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790711833.756444:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790711833.756449:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1877696879764480:0@lo:38:kworker.0 00000100:00080000:0.0:1790711833.756516:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790711833.756522:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790711833.756525:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790711833.756528:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790711833.756532:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dac8fdf1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790711833.756537:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1790711833.756565:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790711833.756576:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dac8fdf1800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711833.756610:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b7480 x1877696879765504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790711833.756667:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790711833.756678:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879765632:0@lo:400:kworker.0 00000400:00000100:0.0:1790711833.756722:0:3608:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879765632 offset 0 length 224: 4 00000100:00100000:2.0:1790711833.759989:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1877696879765504:0@lo:38:kworker.0 00000400:00000100:2.0:1790711833.760065:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879765504 offset 0 length 520: 4 00010000:00010000:1.0:1790711834.458623:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1790711834.714631:0:3610:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711818/real 1790711818] req@ffff9dab8329f800 x1877696879764608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790711834 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711834.735849:0:3610:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9dab8329f800 x1877696879764608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790711834 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790711834.735864:0:3610:0:(import.c:65:import_set_state_nolock()) ffff9daca0132000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790711834.735868:0:3610:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790711834.753293:0:3610:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1790711834.753345:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790711834.753351:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790711834.753354:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790711834.753357:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790711834.753360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790711834.753363:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790711834.753367:0:36:0:(import.c:65:import_set_state_nolock()) ffff9daca0132000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790711834.753374:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 528 00000100:00080000:1.0:1790711834.754111:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9daca0132000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1790711834.754153:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51d7b80 x1877696879765760/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790711834.754199:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1877696879765760:0@lo:38:kworker.0 00000400:00000100:1.0:1790711834.754588:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877696879765760 offset 0 length 520: 4 00000100:00100000:2.0:1790711834.757247:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1877696879764608:0@lo:400:kworker.0 00000020:01000004:2.0:1790711834.901275:0:21237:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790711834.919820:0:21237:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1790711834.919976:0:21237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac994ec800/0xcf3cf816241e04b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e04bd expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.919991:0:21237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac994ec800/0xcf3cf816241e04b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e04bd expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.920000:0:21237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac994ec800/0xcf3cf816241e04b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e04bd expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.920008:0:21237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dac994ec800/0xcf3cf816241e04b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e04bd expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.920123:0:21237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790711834.920130:0:21237:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790711834.920158:0:21237:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790711834.920170:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dacb51b7480 x1877696879765504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790711853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711834.920232:0:21237:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790711834.920238:0:21237:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790711834.920245:0:21237:0:(import.c:65:import_set_state_nolock()) ffff9dac8fdf1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1790711834.920249:0:21237:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790711834.920254:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dacb51b7480 x1877696879765504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790711853 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1790711834.920296:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790711834.920304:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac994ec800/0xcf3cf816241e04b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e04bd expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711834.920312:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac994ec800 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:3.0:1790711834.920316:0:17047:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac994ec800/0xcf3cf816241e04b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e04bd expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711834.920326:0:17047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac994ec800/0xcf3cf816241e04b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e04bd expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790711834.920334:0:17047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac994ec800/0xcf3cf816241e04b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e04bd expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790711834.920341:0:17047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790711834.920344:0:17047:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790711834.920347:0:17047:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790711834.920368:0:17047:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dab84213800 00010000:00010000:3.0:1790711834.920372:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac994ec800/0xcf3cf816241e04b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e04bd expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711834.920379:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac994ec800/0xcf3cf816241e04b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e04bd expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711834.920391:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711834.920393:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711834.920395:0:17047:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711834.921717:0:21237:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790711834.921788:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1877696879765504:0@lo:38:kworker.0 00000100:00100000:2.0:1790711834.921948:0:21237:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1790711834.929297:0:21237:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790711834.929318:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab8329ce00 x1877696879764864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711836 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711834.929422:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dacb51d5500 x1877696879764992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711839 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711834.929443:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab838e5c00 x1877696879765248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711841 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711834.929455:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab838e4000 x1877696879765376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711846 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711834.929473:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dacb51b4700 x1877696879765632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711849 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711834.929482:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dacb51d7b80 x1877696879765760/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790711844 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711834.929496:0:21237:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790711834.929504:0:21237:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790711834.929511:0:21237:0:(import.c:65:import_set_state_nolock()) ffff9daca0132000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790711834.929517:0:21237:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790711834.929521:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab8329ce00 x1877696879764864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711836 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711834.929614:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879765632:0@lo:400:kworker.0 00000100:00100000:0.0:1790711834.929690:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1877696879765376:0@lo:400:kworker.0 00000100:00100000:1.0:1790711834.929761:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1877696879764864:0@lo:400:kworker.0 00000100:00100000:3.0:1790711834.929809:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dacb51d5500 x1877696879764992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711839 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711834.929818:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab838e5c00 x1877696879765248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711841 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711834.929826:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab838e4000 x1877696879765376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711846 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711834.929835:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dacb51b4700 x1877696879765632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711849 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711834.929843:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dacb51d7b80 x1877696879765760/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790711844 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711834.929857:0:21237:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790711834.929896:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879764992:0@lo:400:kworker.0 00000100:00100000:2.0:1790711834.929939:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1877696879765248:0@lo:400:kworker.0 00000100:00100000:1.0:1790711834.930217:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1877696879765760:0@lo:38:kworker.0 00000100:00100000:3.0:1790711834.930475:0:21237:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790711834.932803:0:21237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185200/0xcf3cf816241e048c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0493 expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711834.932822:0:21237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185200/0xcf3cf816241e048c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0493 expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711834.932831:0:21237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185200/0xcf3cf816241e048c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e0493 expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711834.932839:0:21237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dacb5185200/0xcf3cf816241e048c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e0493 expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711834.932977:0:21237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790711834.932988:0:21237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167c400/0xcf3cf816241e0676 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e067d expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711834.932996:0:21237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167c400/0xcf3cf816241e0676 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e067d expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711834.933002:0:21237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167c400/0xcf3cf816241e0676 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e067d expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711834.933009:0:21237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.106@tcp lock: ffff9dac8167c400/0xcf3cf816241e0676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3cf816241e067d expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.933038:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790711834.933123:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dacb5185200/0xcf3cf816241e048c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e0493 expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.933131:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5185200 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:2.0:1790711834.933136:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dacb5185200/0xcf3cf816241e048c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e0493 expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.933145:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dacb5185200/0xcf3cf816241e048c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e0493 expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790711834.933167:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dacb5185200/0xcf3cf816241e048c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e0493 expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711834.933174:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790711834.933177:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1790711834.933189:0:17046:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dab84213800 00010000:00010000:2.0:1790711834.933193:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dacb5185200/0xcf3cf816241e048c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e0493 expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.933200:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dacb5185200/0xcf3cf816241e048c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e0493 expref: -99 pid: 19379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.933215:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711834.933219:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac8167c400/0xcf3cf816241e0676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e067d expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.933225:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167c400 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:2.0:1790711834.933228:0:17046:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167c400/0xcf3cf816241e0676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3cf816241e067d expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.933235:0:17046:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac8167c400/0xcf3cf816241e0676 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e067d expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790711834.933242:0:17046:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167c400/0xcf3cf816241e0676 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e067d expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711834.933248:0:17046:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790711834.933250:0:17046:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1790711834.933253:0:17046:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dab84213800 00010000:00010000:2.0:1790711834.933262:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac8167c400/0xcf3cf816241e0676 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e067d expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.933269:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711834.933270:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711834.933272:0:17046:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711834.933311:0:21237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790711834.933316:0:21237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac8167c400/0xcf3cf816241e0676 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e067d expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790711834.933338:0:21237:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1790711834.933342:0:21237:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1790711834.933344:0:21237:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1790711834.933370:0:21237:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1790711834.933375:0:21237:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1790711834.933379:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790711834.933385:0:21237:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790711834.933389:0:21237:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9dacaed40000) has no exports 00000020:00080000:3.0:1790711834.933413:0:21237:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9dacaed40000) has no exports 00010000:00010000:1.0:1790711834.933643:0:20832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790711834.935825:0:21237:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9dab81f502a0 - data ffff9dac98f13af8/ffff9dacae592c00 00000020:01000000:3.0:1790711834.936120:0:21237:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9dab82e23900 - data ffff9dac98e2c360/ffff9dab82ce5c00 00100000:10000000:3.0:1790711834.950972:0:21237:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790711834.958470:0:21237:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e04a1 00000020:00000080:2.0:1790711834.958482:0:21237:0:(genops.c:885:class_export_put()) final put ffff9dab84242000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1790711834.958563:0:21237:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dac86069000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1790711834.958567:0:21237:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dac86069000 2 00000020:01000004:2.0:1790711834.958570:0:21237:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9dac86069000 from lustre-OST0001 00000020:00000080:2.0:1790711834.958594:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790711834.958602:0:21237:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1790711834.958605:0:21237:0:(genops.c:885:class_export_put()) final put ffff9dac8522c000/lustre-OST0001_UUID 00000020:00000080:2.0:1790711834.958608:0:21237:0:(genops.c:844:class_export_destroy()) destroying export ffff9dac8522c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1790711834.958614:0:21237:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1790711834.958699:0:21237:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e1803113-c9d6-45cb-a2b6-061f96b8256e->MGS 00010000:00010000:2.0:1790711834.958715:0:21237:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dab82d14800/0xcf3cf816241e01ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e01f3 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790711834.958728:0:21237:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d14800/0xcf3cf816241e01ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e01f3 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711834.958735:0:21237:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1790711834.958739:0:21237:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1790711834.958742:0:21237:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1790711834.958755:0:21237:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dab84213800 00010000:00010000:2.0:1790711834.958758:0:21237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dab82d14800/0xcf3cf816241e01ec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e01f3 expref: -99 pid: 17789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711834.958772:0:21237:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dab82d15000/0xcf3cf816241e00db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3cf816241e00e2 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790711834.958787:0:21237:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d15000/0xcf3cf816241e00db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3cf816241e00e2 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711834.958793:0:21237:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790711834.958796:0:21237:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1790711834.958798:0:21237:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1790711834.958806:0:21237:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9dab84213800 00010000:00010000:2.0:1790711834.958810:0:21237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dab82d15000/0xcf3cf816241e00db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3cf816241e00e2 expref: -99 pid: 17037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790711834.958827:0:21237:0:(import.c:65:import_set_state_nolock()) ffff9dab84213800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1790711834.958831:0:21237:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790711834.958833:0:21237:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790711834.958835:0:21237:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1790711834.958839:0:21237:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790711834.958850:0:21237:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9dab838e5f80 x1877696879765120/t0(0) o250->MGC192.168.203.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790711840 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790711834.958872:0:21237:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790711834.958882:0:21237:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1790711834.960653:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e1803113-c9d6-45cb-a2b6-061f96b8256e:3606:1877696879765120:0@lo:250:kworker.0 10000000:01000000:2.0:1790711834.961625:0:21237:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790711834.961640:0:21237:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e00c6 00000020:00000080:2.0:1790711834.961648:0:21237:0:(genops.c:885:class_export_put()) final put ffff9dab84215800/e1803113-c9d6-45cb-a2b6-061f96b8256e 00000020:00000080:0.0:1790711834.962640:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84242000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790711834.968191:0:21237:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.106@tcp (flags='') 00000020:00000080:2.0:1790711834.968208:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790711834.968217:0:21237:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.106@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790711834.968223:0:21237:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9dacb52d8000) has no exports 00000020:00000080:0.0:1790711834.968302:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84215800/e1803113-c9d6-45cb-a2b6-061f96b8256e for MGC192.168.203.106@tcp 10000000:01000000:2.0:1790711834.969115:0:17056:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1790711834.971139:0:21237:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.106@tcp: client import never connected 00000100:00080000:0.0:1790711834.971147:0:21237:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1790711834.971152:0:21237:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790711834.971157:0:21237:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1790711834.971159:0:21237:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1790711834.971249:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790711834.971258:0:21237:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.106@tcp (uuid e1803113-c9d6-45cb-a2b6-061f96b8256e) 00000020:01000000:0.0:1790711834.971268:0:21237:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790711834.971286:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790711834.971292:0:21237:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790711834.971300:0:21237:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9dacbc46e800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790711834.971308:0:21237:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9dacb0e58000) has exports, disconnecting them 00000020:00080000:0.0:1790711834.971312:0:21237:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9dacbc46e800), last request at 1790711761 00000020:00000080:0.0:1790711834.971317:0:21237:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e04cb 00000020:00080000:0.0:1790711834.971336:0:21237:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dacbc46e800): rc 0 00000020:00000080:0.0:1790711834.971341:0:21237:0:(genops.c:885:class_export_put()) final put ffff9dacbc46e800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790711834.971462:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dab84213800 for MGC192.168.203.106@tcp 00000020:00000080:2.0:1790711834.971470:0:8:0:(genops.c:885:class_export_put()) final put ffff9dab84210000/e1803113-c9d6-45cb-a2b6-061f96b8256e 00000020:00000080:2.0:1790711834.971473:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab84210000/e1803113-c9d6-45cb-a2b6-061f96b8256e for MGC192.168.203.106@tcp 00000020:01000000:2.0:1790711834.971494:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.106@tcp (e1803113-c9d6-45cb-a2b6-061f96b8256e) 00000020:00000080:2.0:1790711834.971756:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbc46e800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1790711834.972216:0:21237:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1790711834.972223:0:21237:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790711834.972228:0:21237:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790711834.972234:0:21237:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790711834.972375:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790711834.972381:0:21237:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1790711834.972388:0:21237:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1790711834.972393:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790711834.972397:0:21237:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790711834.972403:0:21237:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9dab82cf3000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790711834.972409:0:21237:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9daca0a23380) has exports, disconnecting them 00000020:00080000:1.0:1790711834.972412:0:21237:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9dab82cf3000), last request at 1790711762 00000020:00000080:1.0:1790711834.972416:0:21237:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e04d9 00000020:00080000:1.0:1790711834.972429:0:21237:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9dab82cf3000): rc 0 00000020:00000080:1.0:1790711834.972433:0:21237:0:(genops.c:885:class_export_put()) final put ffff9dab82cf3000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1790711834.973101:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9dac8fdf1800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790711834.973109:0:8:0:(genops.c:885:class_export_put()) final put ffff9dacbc46c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1790711834.973111:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbc46c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1790711834.973116:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1790711834.973170:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab82cf3000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1790711834.981818:0:21237:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790711834.981828:0:21237:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790711834.981834:0:21237:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790711834.981841:0:21237:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790711834.981876:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9daca0132000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1790711834.982103:0:17047:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1790711834.989374:0:17046:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1790711834.993136:0:20832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1790711834.993331:0:17042:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9dacb128f000:17042] 1 exiting: rc = 0 00000100:00100000:1.0:1790711834.993777:0:17041:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9dacbf996c00:17041] 0 exiting: rc = 1 00000100:00100000:2.0:1790711834.993998:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711834.994262:0:20833:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9dacbc7ce800:20833] 3 exiting: rc = 0 00000100:00100000:1.0:1790711834.998295:0:17045:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9dacb128fe00:17045] 2 exiting: rc = 0 00000100:00100000:1.0:1790711834.998452:0:17043:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9dacb128e000:17043] 0 exiting: rc = 1 00000100:00100000:2.0:1790711835.043688:0:17044:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9dacb128fc00:17044] 1 exiting: rc = 0 00000100:00100000:2.0:1790711835.043806:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043814:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043822:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043828:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043834:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043848:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043856:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043862:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043869:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043888:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043895:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043900:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043906:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043911:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043929:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043935:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043940:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043945:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043950:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043955:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043960:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043965:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043970:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043975:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043982:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043988:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043992:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.043997:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044002:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044007:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044012:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044017:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044023:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044028:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044033:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044038:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044053:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044060:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044065:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044070:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044075:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044080:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044086:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044092:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044098:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044103:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044108:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044113:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044118:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044130:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044136:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044141:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044146:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044151:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044156:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044161:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044167:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044175:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044180:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044185:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044190:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044195:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044201:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.044206:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790711835.044825:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790711835.044833:0:21237:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1790711835.044839:0:21237:0:(genops.c:885:class_export_put()) final put ffff9dacbc46b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1790711835.044843:0:21237:0:(genops.c:844:class_export_destroy()) destroying export ffff9dacbc46b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1790711835.044848:0:21237:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1790711835.044895:0:21237:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dac86069000 1 00000020:00000080:2.0:1790711835.044901:0:21237:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xcf3cf816241e0485 00000020:00000080:2.0:1790711835.044907:0:21237:0:(genops.c:885:class_export_put()) final put ffff9dab82e88800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1790711835.044918:0:21237:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1790711835.044927:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9dab82e88800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790711835.044938:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790711835.044943:0:21237:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790711835.044946:0:21237:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9dacaed5b380) has no exports 00000020:00000080:2.0:1790711835.156445:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790711835.156458:0:21237:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1790711835.156464:0:21237:0:(genops.c:885:class_export_put()) final put ffff9dac8606d800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1790711835.156468:0:21237:0:(genops.c:844:class_export_destroy()) destroying export ffff9dac8606d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790711835.156478:0:21237:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1790711835.157405:0:21237:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9dac8606c800 00000020:01000000:2.0:1790711835.157442:0:21237:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1790711835.157448:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790711835.157454:0:21237:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790711835.157458:0:21237:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9dacb131b380) has no exports 00000020:00000080:2.0:1790711835.157497:0:21237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790711835.157504:0:21237:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1790711835.157508:0:21237:0:(genops.c:885:class_export_put()) final put ffff9dac87ffd800/OSS_uuid 00000020:00000080:2.0:1790711835.157511:0:21237:0:(genops.c:844:class_export_destroy()) destroying export ffff9dac87ffd800/OSS_uuid for OSS 00000020:01000000:2.0:1790711835.157516:0:21237:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1790711835.157669:0:18566:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff9dacbcb5b200:18566] 1 exiting: rc = 0 00000100:00100000:2.0:1790711835.157764:0:18860:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff9dab8331b000:18860] 3 exiting: rc = 0 00000100:00100000:2.0:1790711835.157817:0:18567:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff9dab821e2600:18567] 2 exiting: rc = 0 00000100:00080000:1.0:1790711835.157920:0:17054:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1790711835.158030:0:18565:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff9dacbcaf3000:18565] 0 exiting: rc = 1 00000100:00100000:3.0:1790711835.158921:0:19653:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff9dab82ce1a00:19653] 4 exiting: rc = 0 00000100:00100000:2.0:1790711835.159123:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159132:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159137:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159142:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159148:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159153:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159159:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159164:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159170:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159175:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159180:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159186:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159191:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159197:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159205:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159211:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159216:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159222:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159227:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159233:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159238:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159254:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159259:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159265:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159271:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159276:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159282:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159287:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159293:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159299:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159305:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159311:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159317:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159322:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159329:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159334:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159341:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159346:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159351:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159357:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159363:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159369:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159375:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159380:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159386:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159391:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159395:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159400:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159405:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159410:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159416:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159421:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159426:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159432:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159437:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159442:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159454:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159459:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159465:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159471:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159476:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159482:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159499:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.159505:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.160574:0:18569:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9dab82fa5e00:18569] 1 exiting: rc = 0 00000100:00100000:1.0:1790711835.160647:0:18568:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9dab82fa5200:18568] 0 exiting: rc = 1 00000100:00100000:2.0:1790711835.160845:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160852:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160858:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160864:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160870:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160875:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160880:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160886:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160892:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160898:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160903:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160908:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160914:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160919:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160924:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160930:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160945:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160951:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160955:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160960:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160965:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160970:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160975:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160980:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160985:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160990:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.160995:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161015:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161020:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161026:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161031:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161036:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161041:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161056:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161062:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161067:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161073:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161079:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161084:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161091:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161096:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161101:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161107:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161112:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161118:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161124:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161130:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161136:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161142:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161148:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161154:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161160:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161165:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161171:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161177:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161182:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161187:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161193:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161198:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161203:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161209:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161214:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161228:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.161234:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.170446:0:18570:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9dacb50a9e00:18570] 0 exiting: rc = 1 00000100:00100000:1.0:1790711835.170715:0:18571:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9dacb50a8e00:18571] 1 exiting: rc = 0 00000100:00100000:2.0:1790711835.171091:0:20200:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9dab833be800:20200] 3 exiting: rc = 0 00000100:00100000:2.0:1790711835.171248:0:18572:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9dab81f3a600:18572] 2 exiting: rc = 0 00000100:00100000:2.0:1790711835.171312:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171320:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171327:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171340:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171348:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171354:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171360:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171366:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171373:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171379:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171384:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171390:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171413:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171420:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171425:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171432:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171437:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171442:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171448:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171454:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171459:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171466:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171472:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171476:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171482:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171487:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171492:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171500:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171506:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171511:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171516:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171535:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171761:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171768:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171775:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171781:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171802:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171810:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171817:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171823:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171830:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171836:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171842:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171849:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171855:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171862:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171867:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171874:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171880:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171885:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171891:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171898:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171904:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171910:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171916:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171922:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171928:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.171935:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.172160:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.172167:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.172174:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.172191:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.172199:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790711835.172205:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.195483:0:18573:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9dab82cdda00:18573] 0 exiting: rc = 1 00000100:00100000:0.0:1790711835.195923:0:18574:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9dacbddbd200:18574] 1 exiting: rc = 0 00000100:00100000:1.0:1790711835.197806:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199772:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199787:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199793:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199799:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199804:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199810:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199816:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199821:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199827:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199832:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199838:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199843:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199849:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199855:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199862:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199869:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199875:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199880:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199886:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199891:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199897:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199903:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199909:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199915:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199920:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199926:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199932:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199966:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199975:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199982:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199988:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199994:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.199999:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200005:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200013:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200018:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200024:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200030:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200036:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200041:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200057:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200063:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200068:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200073:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200078:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200082:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200088:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200092:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200097:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200101:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200106:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200111:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200116:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200121:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200126:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200130:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200135:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200140:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200145:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200150:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200156:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200161:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200174:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790711835.200969:0:18575:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9dacbddbc400:18575] 0 exiting: rc = 1 00000100:00100000:3.0:1790711835.208657:0:18576:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9dacbddbc200:18576] 1 exiting: rc = 0 00000100:00100000:0.0:1790711835.208921:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.208929:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.208936:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.208942:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.208948:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.208955:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.208979:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.208985:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.208992:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.208998:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209004:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209010:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209017:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209023:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209029:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209036:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209052:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209060:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209080:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209087:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209093:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209110:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209116:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209122:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209128:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209134:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209141:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209147:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209153:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209159:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209178:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209186:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209192:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209198:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209205:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209211:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209217:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209223:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209229:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209235:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209242:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209248:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209267:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209274:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209280:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209286:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209292:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209299:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209305:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209311:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209318:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209325:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209331:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209338:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209358:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209364:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209375:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209381:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209386:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209393:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209399:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209404:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209410:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790711835.209423:0:21237:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790711835.236020:0:21237:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1790711856.349074:0:22001:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1790711867.355783:0:22600:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790711867.355809:0:22600:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1790711867.355811:0:22600:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1790711867.355936:0:22600:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dacae5ff800 00000020:01000004:3.0:1790711867.355953:0:22600:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1790711867.355961:0:22600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790711867.355977:0:22600:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9dacaed44d40) 00000020:00000080:3.0:1790711867.355992:0:22600:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790711867.435949:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.436489:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790711867.437561:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.437750:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.438014:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.438223:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.438437:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.438634:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.438984:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.439203:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.439425:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.439655:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.439887:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.440101:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.440321:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.440535:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.440871:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.441076:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.441423:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.441633:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.441857:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.442039:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.442262:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.442464:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.442728:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.443123:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.443425:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.443667:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.444650:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.445380:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.445636:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.445902:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1790711867.446115:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.446333:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1790711867.447568:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.447907:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1790711867.448289:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.448491:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.448887:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.449158:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1790711867.449340:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790711867.449530:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1790711867.449728:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790711867.451171:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1790711867.451884:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.452210:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.452760:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.454426:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.455674:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.456020:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.456474:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.456787:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1790711867.457044:0:22600:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1790711867.458536:0:22600:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790711867.458952:0:22600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790711867.458959:0:22600:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790711867.458972:0:22600:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3cf816241e0939 00000020:01000004:2.0:1790711867.458979:0:22600:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1790711867.458984:0:22600:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790711867.458988:0:22600:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dacae5ff800 from MGS 00000020:01000004:2.0:1790711867.458992:0:22600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790711867.459002:0:22600:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9daca0a23380) 00000020:00000080:2.0:1790711867.459013:0:22600:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790711867.459073:0:22600:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dacae5ff800 from MGS, refs=2 00080000:01000000:2.0:1790711867.459078:0:22600:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790711867.459083:0:22600:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3cf816241e0947 00000100:00100000:2.0:1790711867.459174:0:22600:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790711867.459419:0:22600:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790711867.459425:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790711867.460193:0:22600:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790711867.460202:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790711867.460879:0:22600:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790711867.461051:0:22600:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790711867.461057:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790711867.461679:0:22600:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790711867.461686:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790711867.462110:0:22600:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790711867.462117:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790711867.463360:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711867.463365:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711867.463367:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711867.464413:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711867.464417:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711867.464419:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711867.465158:0:22600:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790711867.472598:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1790711867.475658:0:22600:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1790711867.476696:0:22612:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790711867.476828:0:22600:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790711867.476863:0:22600:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790711867.477365:0:22600:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790711867.477956:0:22600:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790711867.478108:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790711867.478114:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790711867.479124:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790711867.479132:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790711867.479438:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790711867.479445:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790711867.482860:0:22600:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790711867.482883:0:22600:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.106@tcp' 00000020:01000004:2.0:1790711867.482885:0:22600:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790711867.482914:0:22600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.106@tcp (typ=mgc) 00000020:00000080:2.0:1790711867.482926:0:22600:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.106@tcp (ffff9daca0a24d40) 00000020:00000080:2.0:1790711867.482951:0:22600:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790711867.483024:0:22600:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dacbcbcc000@MGC192.168.203.106@tcp: add connection 192.168.203.106@tcp at head 00010000:00010000:2.0:1790711867.483167:0:22600:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.106@tcp-0 is initialized 00000040:01000000:2.0:1790711867.483173:0:22600:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 1 is initialized 00000100:00080000:1.0:1790711867.485975:0:22616:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1790711867.496753:0:22619:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790711867.497561:0:22600:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.106@tcp (uuid bc8ed208-5edc-469a-a5f9-449dbe325e20) 00000020:00000080:3.0:1790711867.497584:0:22600:0:(genops.c:1384:class_connect()) connect: client bc8ed208-5edc-469a-a5f9-449dbe325e20, cookie 0xcf3cf816241e0955 00000100:00080000:3.0:1790711867.497595:0:22600:0:(import.c:545:import_select_connection()) MGC192.168.203.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790711867.497605:0:22600:0:(import.c:666:import_select_connection()) MGC192.168.203.106@tcp: import ffff9dacbcbcc000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711867.497638:0:22600:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e5500 x1877696879765888/t0(0) o250->MGC192.168.203.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790711867.497688:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bc8ed208-5edc-469a-a5f9-449dbe325e20:3606:1877696879765888:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790711867.497748:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.497821:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879765888 00000100:00100000:3.0:1790711867.497828:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879765888 00000100:00100000:3.0:1790711867.497868:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790711867.497875:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3606:x1877696879765888:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1790711867.497899:0:22613:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from bc8ed208-5edc-469a-a5f9-449dbe325e20@0@lo t0 exp 0000000000000000 cur 633 last 0 00000020:00000080:3.0:1790711867.497922:0:22613:0:(genops.c:1384:class_connect()) connect: client bc8ed208-5edc-469a-a5f9-449dbe325e20, cookie 0xcf3cf816241e095c 00000100:00080000:3.0:1790711867.498064:0:22613:0:(import.c:65:import_set_state_nolock()) ffff9dacae5fb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790711867.498114:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+5:3606:x1877696879765888:12345-0@lo:250:mount.lustre.0 Request processed in 238us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711867.498134:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790711867.498177:0:3606:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1790711867.498184:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.106@tcp: connect to target with instance 0 00000100:00080000:3.0:1790711867.498190:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1790711867.498193:0:3606:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1790711867.498196:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacbcbcc000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1790711867.498198:0:3606:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1790711867.498208:0:3606:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1790711867.498213:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bc8ed208-5edc-469a-a5f9-449dbe325e20:3606:1877696879765888:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1790711867.498231:0:22600:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bc8ed208-5edc-469a-a5f9-449dbe325e20->MGS 00000020:01000004:3.0:1790711867.498246:0:22600:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790711867.498251:0:22600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790711867.498263:0:22600:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9dacaed419c0) 00000020:00000080:3.0:1790711867.498273:0:22600:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790711867.518342:0:22600:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790711867.519190:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790711867.519197:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790711867.522171:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790711867.522188:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790711867.522923:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790711867.522932:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790711867.523891:0:22600:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790711867.524145:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790711867.524152:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790711867.524870:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790711867.524878:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790711867.570271:0:22600:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790711867.570488:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790711867.570495:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790711867.572053:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790711867.572066:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790711867.572842:0:22600:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790711867.573017:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790711867.573022:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790711867.578641:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790711867.578678:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790711867.579702:0:22600:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790711867.579933:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790711867.579939:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790711867.582392:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790711867.582404:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790711867.584649:0:22600:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790711867.587696:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790711867.587714:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790711867.591527:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790711867.591561:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1790711867.619989:0:22600:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790711867.620238:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790711867.620245:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1790711867.622971:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790711867.622990:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1790711867.633958:0:22600:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790711867.633971:0:22600:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1790711867.635777:0:22600:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1790711867.635815:0:22600:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1790711867.635823:0:22600:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1790711867.635924:0:22600:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790711867.635960:0:22600:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1790711867.635965:0:22600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790711867.635966:0:22600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790711867.635968:0:22600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790711867.635969:0:22600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790711867.635970:0:22600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790711867.635972:0:22600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790711867.635973:0:22600:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790711867.635975:0:22600:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790711867.635977:0:22600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790711867.635978:0:22600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790711867.635980:0:22600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1790711867.635982:0:22600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790711867.635983:0:22600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790711867.635984:0:22600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790711867.635985:0:22600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790711867.635986:0:22600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790711867.635987:0:22600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790711867.635988:0:22600:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790711867.635989:0:22600:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790711867.635990:0:22600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790711867.635991:0:22600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790711867.636017:0:22600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790711867.636038:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790711867.636134:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711867.636186:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac9bc76780 going to sleep for 11 seconds 00000100:00100000:0.0:1790711867.636310:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879766016 00000100:00100000:0.0:1790711867.636318:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879766016 00000100:00100000:0.0:1790711867.636358:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790711867.636367:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+5:22600:x1877696879766016:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790711867.636412:0:22615:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790711867.636415:0:22615:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790711867.636418:0:22615:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1790711867.648405:0:22637:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790711867.652432:0:22615:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1790711867.656842:0:22638:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790711867.656850:0:22638:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1790711867.656862:0:22638:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790711867.656865:0:22638:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790711867.661985:0:22638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1790711867.662410:0:22615:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790711867.662422:0:22615:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790711867.669354:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+5:22600:x1877696879766016:12345-0@lo:253:mount.lustre.0 Request processed in 32980us (33212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711867.669369:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790711867.670502:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766016:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790711867.670711:0:22600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790711867.670714:0:22600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790711867.670716:0:22600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790711867.670717:0:22600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790711867.670718:0:22600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790711867.670719:0:22600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790711867.670720:0:22600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790711867.670722:0:22600:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790711867.670723:0:22600:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790711867.670725:0:22600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790711867.670726:0:22600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790711867.671581:0:22600:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dacae5ff800 from lustre-MDT0000 10000000:01000000:2.0:1790711867.671667:0:22600:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790711867.671671:0:22600:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790711867.671676:0:22600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9daca0a24d40 10000000:01000000:2.0:1790711867.671680:0:22600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790711867.671690:0:22600:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9daca0a24d40 from 1 10000000:01000000:2.0:1790711867.671693:0:22600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790711867.671738:0:22600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.671748:0:22600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.671757:0:22600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711867.671779:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790711867.671929:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711867.671989:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb44c79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790711867.672018:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879766144 00000100:00100000:0.0:1790711867.672027:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879766144 00000100:00100000:0.0:1790711867.672078:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790711867.672087:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+5:22600:x1877696879766144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790711867.672100:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711867.672116:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac80031400/0xcf3cf816241e0971 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e096a expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.672141:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac80031400/0xcf3cf816241e0971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e096a expref: 6 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.672151:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac80031400/0xcf3cf816241e0971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e096a expref: 6 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.672159:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac80031400, rc 0) 00000100:00100000:0.0:1790711867.672206:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+6:22600:x1877696879766144:12345-0@lo:101:mount.lustre.0 Request processed in 121us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711867.672213:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790711867.674312:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790711867.674348:0:22600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.674429:0:22600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711867.674521:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790711867.674625:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711867.674766:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879766272 00000100:00100000:0.0:1790711867.674774:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879766272 00000100:00100000:0.0:1790711867.674833:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790711867.674842:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+6:22600:x1877696879766272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790711867.681257:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+6:22600:x1877696879766272:12345-0@lo:501:mount.lustre.0 Request processed in 6407us (6623us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790711867.681295:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790711867.684184:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb44c79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790711867.684225:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766272:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790711867.684273:0:22600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790711867.684297:0:22600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.684310:0:22600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790711867.684319:0:22600:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dacae5ff800 10000000:01000000:3.0:1790711867.684328:0:22600:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790711867.684334:0:22600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dacae5ff800 10000000:01000000:3.0:1790711867.684336:0:22600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790711867.684339:0:22600:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dacae5ff800 from 1 10000000:01000000:3.0:1790711867.684342:0:22600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790711867.684378:0:22600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.684386:0:22600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.684397:0:22600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711867.684415:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790711867.684470:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.685224:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac894d7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790711867.691329:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879766400 00000100:00100000:0.0:1790711867.691360:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879766400 00000100:00100000:0.0:1790711867.691419:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790711867.691428:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+6:22600:x1877696879766400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790711867.691444:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711867.691466:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac80031a00/0xcf3cf816241e097f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0978 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.691501:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac80031a00/0xcf3cf816241e097f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0978 expref: 7 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.691512:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac80031a00/0xcf3cf816241e097f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0978 expref: 7 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.691521:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac80031a00, rc 0) 00000100:00100000:0.0:1790711867.691639:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+7:22600:x1877696879766400:12345-0@lo:101:mount.lustre.0 Request processed in 212us (7168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711867.691647:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790711867.691819:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790711867.691837:0:22600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0978 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e097f expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.691847:0:22600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0978 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e097f expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711867.691865:0:22600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790711867.691883:0:22600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0978 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e097f expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.691891:0:22600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d12200/0xcf3cf816241e0978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e097f expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711867.691899:0:22600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790711867.691904:0:22600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790711867.691911:0:22600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dacae5ff800 10000000:01000000:2.0:1790711867.691913:0:22600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790711867.691918:0:22600:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790711867.691921:0:22600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790711867.691947:0:22600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15e00/0xcf3cf816241e0986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.691967:0:22600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d15e00/0xcf3cf816241e0986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.691976:0:22600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d15e00/0xcf3cf816241e0986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711867.691996:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790711867.692032:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711867.692064:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb44c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1790711867.695818:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879766528 00000100:00100000:1.0:1790711867.695834:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879766528 00000100:00100000:1.0:1790711867.695909:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790711867.695920:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+7:22600:x1877696879766528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790711867.695937:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711867.695959:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacbcb75c00/0xcf3cf816241e098d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0986 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711867.695985:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb75c00/0xcf3cf816241e098d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0986 expref: 8 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711867.695994:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacbcb75c00/0xcf3cf816241e098d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0986 expref: 8 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711867.696003:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacbcb75c00, rc 0) 00000100:00100000:1.0:1790711867.696104:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+8:22600:x1877696879766528:12345-0@lo:101:mount.lustre.0 Request processed in 186us (4070us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711867.696111:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790711867.697071:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790711867.697097:0:22600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d15e00/0xcf3cf816241e0986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e098d expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.697114:0:22600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d15e00/0xcf3cf816241e0986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e098d expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711867.697201:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790711867.697247:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711867.697282:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb44c7000 going to sleep for 11 seconds 00000100:00100000:3.0:1790711867.697755:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879766656 00000100:00100000:3.0:1790711867.697763:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879766656 00000100:00100000:3.0:1790711867.697832:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790711867.697840:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+8:22600:x1877696879766656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790711867.698201:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+9:22600:x1877696879766656:12345-0@lo:501:mount.lustre.0 Request processed in 361us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711867.698209:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790711867.699235:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711867.699294:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790711867.699367:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711867.699409:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca09319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790711867.699515:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879766784 00000100:00100000:2.0:1790711867.699522:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879766784 00000100:00100000:2.0:1790711867.699596:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790711867.699605:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+9:22600:x1877696879766784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790711867.701353:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+9:22600:x1877696879766784:12345-0@lo:503:mount.lustre.0 Request processed in 1743us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711867.701365:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790711867.701513:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879766784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790711867.702740:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22639:1877696879766912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790711867.702827:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711867.702875:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac87683300 going to sleep for 11 seconds 00000100:00100000:1.0:1790711867.702879:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879766912 00000100:00100000:1.0:1790711867.702886:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879766912 00000100:00100000:1.0:1790711867.702931:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790711867.702939:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+9:22639:x1877696879766912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790711867.703596:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+9:22639:x1877696879766912:12345-0@lo:502:llog_process_th.0 Request processed in 655us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711867.703604:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790711867.703761:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22639:1877696879766912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790711867.703861:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790711867.703873:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.703876:0:22639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790711867.703884:0:22639:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1790711867.703887:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790711867.703903:0:22639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9dacaed58000) 00000020:00000080:0.0:1790711867.703919:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1790711867.703924:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790711867.704008:0:22639:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790711867.704015:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3cf816241e099b 00000020:00000080:0.0:1790711867.704232:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790711867.704237:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711867.704241:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.704242:0:22639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1790711867.704245:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790711867.704249:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.704250:0:22639:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1790711867.704254:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790711867.704262:0:22639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9dacaed5b380) 00000020:00000080:0.0:1790711867.704271:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1790711867.704276:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790711867.704277:0:22639:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1790711867.704281:0:22639:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1790711867.704286:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790711867.704330:0:22639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dacae5ff800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1790711867.704343:0:22639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9dacaed599c0) 00000020:00000080:0.0:1790711867.704350:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1790711867.704399:0:22639:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790711867.704404:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3cf816241e09b0 00000020:00000080:0.0:1790711867.704497:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1790711867.704504:0:22639:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790711867.704508:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcf3cf816241e09b7 00080000:01000000:0.0:1790711867.704523:0:22639:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:0.0:1790711867.704527:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3cf816241e09be 00010000:00010000:3.0:1790711867.806788:0:22639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1790711867.808181:0:22639:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1790711867.808674:0:22639:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790711867.809148:0:22639:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9dacaed43380) 00000020:00000080:3.0:1790711867.809165:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790711867.809247:0:22639:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790711867.809255:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3cf816241e09cc 00000020:00000080:2.0:1790711867.810260:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790711867.820268:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcf3cf816241e09d3 00000020:00000080:0.0:1790711867.824060:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790711867.824076:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711867.824084:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.824087:0:22639:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790711867.824091:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790711867.824094:0:22639:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1790711867.824096:0:22639:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790711867.824098:0:22639:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790711867.824099:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790711867.824102:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.824104:0:22639:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790711867.824107:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790711867.824113:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.824114:0:22639:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790711867.824119:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790711867.824170:0:22639:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790711867.824184:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711867.824187:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.824189:0:22639:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1790711867.824191:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790711867.824195:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.824196:0:22639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1790711867.824199:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790711867.824205:0:22639:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000020:00000080:0.0:1790711867.824231:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790711867.824249:0:22639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9dacaed5cd40) 00000020:00000080:0.0:1790711867.824267:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1790711867.824272:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790711867.824325:0:22639:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1790711867.824333:0:22639:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790711867.824340:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3cf816241e09e1 00010000:00080000:0.0:1790711867.824370:0:22639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9daca0a46800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.106@tcp at head 00010000:00010000:0.0:1790711867.832519:0:22639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1790711867.835459:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790711867.835475:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1790711867.835512:0:22639:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790711867.835531:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3cf816241e09e8 00000100:00080000:0.0:1790711867.835915:0:22639:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790711867.835932:0:22639:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9daca0a46800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711867.835971:0:22639:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b5500 x1877696879767040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790711867.836039:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879767040:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790711867.836113:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711867.836212:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879767040 00000100:00100000:1.0:1790711867.836220:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879767040 00000100:00100000:1.0:1790711867.836258:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790711867.836266:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1877696879767040:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1790711867.836281:0:22626:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1790711867.839948:0:22639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1790711867.840074:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711867.840082:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.840085:0:22639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1790711867.840089:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790711867.840093:0:22639:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1790711867.840095:0:22639:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790711867.840097:0:22639:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790711867.840099:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790711867.840102:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.840103:0:22639:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790711867.840106:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790711867.840111:0:22639:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1790711867.840115:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.840117:0:22639:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790711867.840120:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790711867.840123:0:22639:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000020:01000000:0.0:1790711867.840148:0:22639:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790711867.840150:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790711867.840171:0:22639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9dacb52d8000) 00000020:00000080:0.0:1790711867.840191:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1790711867.840196:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790711867.840291:0:22639:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790711867.840298:0:22639:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:0.0:1790711867.840304:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3cf816241e09f6 00010000:00080000:0.0:1790711867.840337:0:22639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9daca0a46000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.106@tcp at head 00010000:00010000:0.0:1790711867.840612:0:22639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1790711867.841629:0:22639:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790711867.841926:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790711867.845139:0:22639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790711867.845945:0:22639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1790711867.855847:0:22639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1790711867.863592:0:22646:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790711867.863605:0:22646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790711867.867876:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790711867.867977:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790711867.868022:0:22639:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790711867.868043:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3cf816241e09fd 00000100:00080000:0.0:1790711867.868054:0:22639:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790711867.868065:0:22639:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9daca0a46000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711867.868123:0:22639:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b6d80 x1877696879767168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790711867.868151:0:22639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790711867.868199:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711867.868203:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.868206:0:22639:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790711867.868209:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790711867.868212:0:22639:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1790711867.868213:0:22639:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790711867.868215:0:22639:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790711867.868217:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790711867.868219:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.868221:0:22639:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790711867.868224:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790711867.868228:0:22639:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1790711867.868232:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711867.868239:0:22639:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790711867.868243:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790711867.868247:0:22639:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000020:01000000:0.0:1790711867.868269:0:22639:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790711867.868271:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790711867.868283:0:22639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9dacb52db380) 00000020:00000080:0.0:1790711867.868294:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1790711867.868298:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790711867.868352:0:22639:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1790711867.868360:0:22639:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:0.0:1790711867.868364:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3cf816241e0a0b 00010000:00080000:0.0:1790711867.868400:0:22639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dab81c7d000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.106@tcp at head 00010000:00010000:0.0:1790711867.868609:0:22639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1790711867.868673:0:22639:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790711867.868685:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1790711867.869332:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879767168:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790711867.869385:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696879767168 offset 0 length 520: 4 00000100:00100000:2.0:1790711867.869753:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1877696879767040:12345-0@lo:38:llog_process_th.0 Request processed in 33485us (33638us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790711867.869769:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790711867.869859:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790711867.869864:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790711867.869868:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879767040:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1790711867.873589:0:22639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790711867.873911:0:22639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1790711867.874020:0:22639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1790711867.876123:0:22648:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790711867.876129:0:22648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790711867.879205:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790711867.879220:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790711867.879280:0:22639:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790711867.879300:0:22639:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3cf816241e0a12 00000100:00080000:3.0:1790711867.879313:0:22639:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790711867.879325:0:22639:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dab81c7d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711867.879362:0:22639:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e7800 x1877696879767296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790711867.879435:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879767296:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790711867.879492:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696879767296 offset 0 length 520: 4 00000100:00080000:3.0:1790711867.879725:0:22639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790711867.879834:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790711867.879839:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711867.879841:0:22639:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790711867.879844:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790711867.879848:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711867.879849:0:22639:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790711867.879852:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790711867.879854:0:22639:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790711867.879856:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790711867.879858:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711867.879859:0:22639:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790711867.879861:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790711867.879863:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711867.879865:0:22639:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790711867.879868:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790711867.879899:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22639:1877696879767424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790711867.879952:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.879983:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879767424 00000100:00100000:3.0:1790711867.879990:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879767424 00000100:00100000:3.0:1790711867.880033:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790711867.880052:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+9:22639:x1877696879767424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790711867.880164:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+9:22639:x1877696879767424:12345-0@lo:502:llog_process_th.0 Request processed in 122us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711867.880179:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790711867.880220:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac98a2f300 going to sleep for 11 seconds 00000100:00100000:3.0:1790711867.880235:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22639:1877696879767424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790711867.880258:0:22639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790711867.880262:0:22639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711867.880263:0:22639:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790711867.880267:0:22639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1790711867.880431:0:22600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1790711867.880451:0:22600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790711867.880468:0:22600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15e00/0xcf3cf816241e0986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e098d expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.880479:0:22600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d15e00/0xcf3cf816241e0986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e098d expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711867.880487:0:22600:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dacae5ff800 from 1 10000000:01000000:2.0:1790711867.880490:0:22600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790711867.880517:0:22600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.880525:0:22600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.880534:0:22600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711867.880574:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879767552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790711867.880602:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711867.880625:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac85668600 going to sleep for 11 seconds 00000100:00100000:1.0:1790711867.880876:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879767552 00000100:00100000:1.0:1790711867.880881:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879767552 00000100:00100000:1.0:1790711867.880936:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790711867.880944:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+9:22600:x1877696879767552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790711867.880954:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711867.880966:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0a20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0a19 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711867.880985:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0a19 expref: 10 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711867.880996:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0a19 expref: 10 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711867.881012:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacbcb74e00, rc 0) 00000100:00100000:1.0:1790711867.881060:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+10:22600:x1877696879767552:12345-0@lo:101:mount.lustre.0 Request processed in 117us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711867.881070:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790711867.881234:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879767552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790711867.881257:0:22600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.881265:0:22600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711867.881855:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879767680:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1790711867.881900:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711867.882291:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac85668600 going to sleep for 11 seconds 00000100:00100000:3.0:1790711867.882368:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879767680 00000100:00100000:3.0:1790711867.882375:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879767680 00000100:00100000:3.0:1790711867.882408:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790711867.882416:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+10:22600:x1877696879767680:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1790711867.882434:0:22615:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790711867.882440:0:22615:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790711867.882721:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+10:22600:x1877696879767680:12345-0@lo:256:mount.lustre.0 Request processed in 306us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711867.882729:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790711867.882886:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879767680:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1790711867.883500:0:22600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790711867.883767:0:22600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.883779:0:22600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711867.883787:0:22600:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dacae5ff800 from 1 10000000:01000000:2.0:1790711867.883790:0:22600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790711867.883832:0:22600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.883841:0:22600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.883851:0:22600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711867.883869:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879767808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790711867.885470:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711867.885794:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac85668600 going to sleep for 11 seconds 00000100:00100000:1.0:1790711867.885912:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879767808 00000100:00100000:1.0:1790711867.885926:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879767808 00000100:00100000:1.0:1790711867.886034:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790711867.886055:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+10:22600:x1877696879767808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790711867.886078:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711867.886102:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacbcb74c00/0xcf3cf816241e0a2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0a27 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711867.886134:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb74c00/0xcf3cf816241e0a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0a27 expref: 11 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711867.886146:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacbcb74c00/0xcf3cf816241e0a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0a27 expref: 11 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711867.886155:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacbcb74c00, rc 0) 00000100:00100000:1.0:1790711867.886215:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:22600:x1877696879767808:12345-0@lo:101:mount.lustre.0 Request processed in 172us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711867.886222:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790711867.886300:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879767808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790711867.886317:0:22600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.886326:0:22600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711867.886394:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879767936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790711867.886422:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.886747:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac98a2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1790711867.886797:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879767936 00000100:00100000:2.0:1790711867.886810:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879767936 00000100:00100000:2.0:1790711867.886833:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790711867.886839:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:22600:x1877696879767936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790711867.886975:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:22600:x1877696879767936:12345-0@lo:501:mount.lustre.0 Request processed in 135us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711867.886982:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790711867.887620:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879767936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790711867.887672:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879768064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790711867.887722:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.887745:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac98a2ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1790711867.887870:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879768064 00000100:00100000:0.0:1790711867.887875:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879768064 00000100:00100000:0.0:1790711867.887906:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790711867.887914:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:22600:x1877696879768064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790711867.888603:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:22600:x1877696879768064:12345-0@lo:503:mount.lustre.0 Request processed in 687us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711867.888613:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790711867.888766:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879768064:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790711867.889451:0:22650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22650:1877696879768192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790711867.889504:0:22650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711867.889820:0:22650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dab831e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790711867.889865:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879768192 00000100:00100000:2.0:1790711867.889871:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879768192 00000100:00100000:2.0:1790711867.890380:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790711867.890393:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:22650:x1877696879768192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790711867.891505:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:22650:x1877696879768192:12345-0@lo:502:llog_process_th.0 Request processed in 1112us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711867.891774:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790711867.891907:0:22650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22650:1877696879768192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790711867.891959:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790711867.892300:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711867.892303:0:22650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790711867.892312:0:22650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dacae5ff800 00000020:00000080:1.0:1790711867.892315:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790711867.892323:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790711867.892325:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711867.892326:0:22650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790711867.892328:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790711867.892331:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711867.892332:0:22650:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790711867.892335:0:22650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dacae5ff800 00000020:00000080:1.0:1790711867.892337:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790711867.892400:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790711867.892405:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711867.892406:0:22650:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790711867.892408:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790711867.892411:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711867.892412:0:22650:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790711867.892415:0:22650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dacae5ff800 00000020:00000080:1.0:1790711867.892417:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790711867.892436:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790711867.892438:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711867.892440:0:22650:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790711867.892442:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790711867.892444:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711867.892445:0:22650:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790711867.892448:0:22650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dacae5ff800 00000020:00000080:1.0:1790711867.892451:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790711867.892494:0:22650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22650:1877696879768320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790711867.892587:0:22650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711867.899083:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879768320 00000100:00100000:0.0:1790711867.899099:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879768320 00000100:00100000:0.0:1790711867.899166:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790711867.899176:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:22650:x1877696879768320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790711867.899334:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:22650:x1877696879768320:12345-0@lo:502:llog_process_th.0 Request processed in 160us (6747us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711867.899343:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790711867.902792:0:22650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac98b11cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790711867.902908:0:22650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22650:1877696879768320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790711867.902949:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790711867.902957:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711867.902959:0:22650:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790711867.902963:0:22650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790711867.914864:0:22600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790711867.914899:0:22600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790711867.914925:0:22600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.914937:0:22600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790711867.915013:0:22600:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790711867.915016:0:22600:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dacae5ff800 10000000:01000000:3.0:1790711867.915019:0:22600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dacae5ff800 10000000:01000000:3.0:1790711867.915024:0:22600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790711867.915029:0:22600:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dacae5ff800 from 1 10000000:01000000:3.0:1790711867.915032:0:22600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790711867.915068:0:22600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d12e00/0xcf3cf816241e0a35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.915077:0:22600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d12e00/0xcf3cf816241e0a35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.915089:0:22600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d12e00/0xcf3cf816241e0a35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711867.915113:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879768448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790711867.915188:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.915230:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac994ffe40 going to sleep for 11 seconds 00000100:00100000:0.0:1790711867.915483:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879768448 00000100:00100000:0.0:1790711867.915491:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879768448 00000100:00100000:0.0:1790711867.916074:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790711867.916086:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:22600:x1877696879768448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790711867.916101:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711867.916115:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac80030600/0xcf3cf816241e0a3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0a35 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.916140:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac80030600/0xcf3cf816241e0a3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0a35 expref: 12 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.916152:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac80030600/0xcf3cf816241e0a3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0a35 expref: 12 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.916160:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac80030600, rc 0) 00000100:00100000:0.0:1790711867.916220:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22600:x1877696879768448:12345-0@lo:101:mount.lustre.0 Request processed in 137us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711867.916228:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790711867.916304:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879768448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790711867.916319:0:22600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d12e00/0xcf3cf816241e0a35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a3c expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.916328:0:22600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d12e00/0xcf3cf816241e0a35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0a3c expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711867.916390:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879768576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790711867.916421:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.924873:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac994ffe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790711867.925134:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879768576 00000100:00100000:2.0:1790711867.925145:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879768576 00000100:00100000:2.0:1790711867.925203:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790711867.925213:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22600:x1877696879768576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790711867.925398:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22600:x1877696879768576:12345-0@lo:501:mount.lustre.0 Request processed in 186us (8975us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711867.925406:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790711867.925493:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879768576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790711867.925586:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879768704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790711867.926899:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.926954:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac994ffe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790711867.927219:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879768704 00000100:00100000:2.0:1790711867.927228:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879768704 00000100:00100000:2.0:1790711867.927265:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790711867.927272:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22600:x1877696879768704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790711867.927670:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22600:x1877696879768704:12345-0@lo:503:mount.lustre.0 Request processed in 397us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711867.927678:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790711867.927948:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879768704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790711867.929210:0:22656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22656:1877696879768832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790711867.929279:0:22656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.929343:0:22656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac994ffcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790711867.929376:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879768832 00000100:00100000:0.0:1790711867.929381:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879768832 00000100:00100000:0.0:1790711867.929427:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790711867.929435:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22656:x1877696879768832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790711867.930046:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22656:x1877696879768832:12345-0@lo:502:llog_process_th.0 Request processed in 608us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711867.930062:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790711867.930149:0:22656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22656:1877696879768832:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1790711867.930211:0:22656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790711867.930229:0:22656:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9dacaed40000) 00000020:00000080:3.0:1790711867.930249:0:22656:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1790711867.930337:0:22656:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dacae5ff800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790711867.930346:0:22656:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dacae5ff800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790711867.930348:0:22656:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dacae5ff800 4 00010000:00080000:3.0:1790711867.930377:0:22656:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dab833a7800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1790711867.932890:0:22656:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1790711867.933515:0:22656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790711867.933594:0:22656:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790711867.933608:0:22656:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcf3cf816241e0a4a 00000100:00080000:3.0:1790711867.933620:0:22656:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790711867.933632:0:22656:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dab833a7800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711867.933750:0:22656:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e6d80 x1877696879768960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790711867.933771:0:22656:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790711867.933909:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877696879768960:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1790711867.934005:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790711867.934010:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790711867.934013:0:8:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790711867.934018:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:3.0:1790711867.934023:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790711867.934029:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9daca0a46800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711867.934044:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e7100 x1877696879769088/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790711867.934055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711867.934059:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711867.934062:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711867.934066:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790711867.934132:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711867.934370:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879769088:0@lo:38:kworker.0 00000100:00100000:0.0:1790711867.934400:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.934515:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879769088 00000100:00100000:3.0:1790711867.934526:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879769088 00000100:00100000:3.0:1790711867.934588:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790711867.934596:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3606:x1877696879769088:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790711867.934718:0:22627:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790711867.934766:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3606:x1877696879769088:12345-0@lo:38:kworker.0 Request processed in 170us (364us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790711867.934777:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790711867.934909:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790711867.934914:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790711867.934919:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879769088:0@lo:38:kworker.0 00000100:00100000:3.0:1790711867.935084:0:22656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22656:1877696879769216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790711867.935131:0:22656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.935154:0:22656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac994ff300 going to sleep for 11 seconds 00000100:00100000:0.0:1790711867.935724:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879769216 00000100:00100000:0.0:1790711867.935730:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879769216 00000100:00100000:0.0:1790711867.935894:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790711867.935903:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22656:x1877696879769216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790711867.936033:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22656:x1877696879769216:12345-0@lo:502:llog_process_th.0 Request processed in 130us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711867.936040:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790711867.936126:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879768960 00000100:00100000:1.0:1790711867.936131:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879768960 00000100:00100000:1.0:1790711867.936169:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790711867.936174:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1877696879768960:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790711867.936223:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3606:x1877696879768960:12345-0@lo:38:llog_process_th.0 Request processed in 47us (2091us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790711867.936229:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790711867.936290:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790711867.936298:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab833a7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790711867.936301:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790711867.936304:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877696879768960:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790711867.939022:0:22656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22656:1877696879769216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790711867.939234:0:22656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22656:1877696879769344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790711867.939303:0:22656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.939350:0:22656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca01f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1790711867.939535:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879769344 00000100:00100000:1.0:1790711867.939560:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879769344 00000100:00100000:1.0:1790711867.939607:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790711867.939615:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22656:x1877696879769344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790711867.939727:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22656:x1877696879769344:12345-0@lo:502:llog_process_th.0 Request processed in 113us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711867.939735:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790711867.939779:0:22656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bc8ed208-5edc-469a-a5f9-449dbe325e20:22656:1877696879769344:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790711867.939797:0:22656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790711867.940230:0:22600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790711867.940254:0:22600:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790711867.940270:0:22600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d12e00/0xcf3cf816241e0a35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a3c expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711867.940282:0:22600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d12e00/0xcf3cf816241e0a35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a3c expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790711867.940331:0:22600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790711867.940333:0:22600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790711867.940334:0:22600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790711867.940336:0:22600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790711867.940337:0:22600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790711867.940338:0:22600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790711867.940340:0:22600:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790711867.940341:0:22600:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790711867.940343:0:22600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790711867.940344:0:22600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790711867.940348:0:22600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790711867.940350:0:22600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790711867.940352:0:22600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790711867.940353:0:22600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790711867.940354:0:22600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790711867.940355:0:22600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790711867.940356:0:22600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790711867.940357:0:22600:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790711867.940358:0:22600:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790711867.940359:0:22600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790711867.940360:0:22600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790711867.940376:0:22600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790711867.940391:0:22600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879769472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790711867.941361:0:22600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711867.941402:0:22600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4762b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790711867.941533:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879769472 00000100:00100000:1.0:1790711867.941566:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879769472 00000100:00100000:1.0:1790711867.941600:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790711867.941606:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22600:x1877696879769472:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790711867.941631:0:22613:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790711867.941643:0:22613:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790711867.944738:0:22613:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790711867.944752:0:22613:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790711867.945369:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22600:x1877696879769472:12345-0@lo:253:mount.lustre.0 Request processed in 3757us (4924us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711867.945382:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790711867.947163:0:22600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:22600:1877696879769472:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790711867.947184:0:22600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790711867.947187:0:22600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790711867.947189:0:22600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790711867.947190:0:22600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790711867.947191:0:22600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790711867.947192:0:22600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790711867.947194:0:22600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790711867.947195:0:22600:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790711867.947197:0:22600:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790711867.947199:0:22600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790711867.947200:0:22600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790711867.947215:0:22600:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1790711867.947745:0:22637:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790711867.947751:0:22637:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790711867.947775:0:22637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.947791:0:22637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0a19 expref: 11 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.947808:0:22637:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.947845:0:22637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0a19 expref: 11 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.947943:0:22637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0a20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0a19 expref: 11 pid: 22614 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711867.947958:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879769600:0@lo:104: 00000100:00100000:3.0:1790711867.948014:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.948066:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84f6e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790711867.948081:0:22604:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879769600 00000100:00100000:1.0:1790711867.948087:0:22604:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879769600 00000100:00100000:1.0:1790711867.948135:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790711867.948150:0:22604:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:22637:x1877696879769600:12345-0@lo:104: 00010000:00010000:1.0:1790711867.948163:0:22604:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711867.948217:0:22604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790711867.948223:0:22604:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:22637:x1877696879769600:12345-0@lo:104: Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711867.948230:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790711867.948230:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711867.948236:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.948242:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d14c00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711867.948246:0:22610:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.948255:0:22610:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711867.948264:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879769600:0@lo:104: 10000000:00010000:0.0:1790711867.948273:0:22610:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711867.948278:0:22637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711867.948279:0:22610:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790711867.948307:0:22610:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.948314:0:22610:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790711867.948395:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bc8ed208-5edc-469a-a5f9-449dbe325e20:3608:1877696879769728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790711867.948423:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711867.948522:0:22606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879769728 00000100:00100000:3.0:1790711867.948527:0:22606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879769728 00010000:00010000:3.0:1790711867.948567:0:22606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0a20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0a19 expref: 12 pid: 22614 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711867.948590:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790711867.948597:0:22606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:3608:x1877696879769728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790711867.948607:0:22606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790711867.948612:0:22606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0a20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0a19 expref: 12 pid: 22614 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.948622:0:22606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0a19 expref: 12 pid: 22614 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.948636:0:22606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0a20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0a19 expref: 12 pid: 22614 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.948660:0:22606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.948668:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790711867.948691:0:22606:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000941254s 00010000:00010000:3.0:1790711867.948696:0:22606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.948703:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.948710:0:22606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.948717:0:22606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.948723:0:22606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d12400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:3.0:1790711867.948727:0:22606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.948734:0:22606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.948747:0:22606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711867.948755:0:22606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790711867.948963:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.948971:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0a20 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.948989:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711867.948991:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711867.948993:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711867.962709:0:22637:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.962726:0:22637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711867.962734:0:22637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d12400/0xcf3cf816241e0a51 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711867.965206:0:22606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:3608:x1877696879769728:12345-0@lo:103:ldlm_bl.0 Request processed in 16599us (16770us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711867.965221:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790711867.966282:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bc8ed208-5edc-469a-a5f9-449dbe325e20:3608:1877696879769728:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1790711867.980210:0:22600:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1790711867.980891:0:22600:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790711867.981086:0:22661:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1790711867.981091:0:22661:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1790711867.981202:0:22662:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790711867.981394:0:22600:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1790711867.981589:0:22662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1790711867.982002:0:22663:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9dab838e7100 x1877696879769856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711867.982021:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00000040:01000000:2.0:1790711867.982357:0:22600:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790711867.982390:0:22600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790711867.984020:0:22600:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790711867.984038:0:22600:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790711867.984106:0:22600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790711867.984854:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790711867.985360:0:22662:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1790711867.988113:0:22600:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1790711867.989605:0:22600:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790711867.989679:0:22600:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790711867.990701:0:22600:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1790711867.991471:0:22600:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1790711867.994376:0:22600:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1790711867.997866:0:22600:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790711867.997909:0:22600:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb22b418e3988 00100000:10000000:0.0:1790711867.997918:0:22600:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790711868.000203:0:22600:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790711868.000221:0:22600:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790711868.000239:0:22600:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1790711868.000258:0:22600:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1790711868.005586:0:22600:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790711868.005786:0:22600:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790711868.510814:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790711868.763828:0:22619:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790711868.763837:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dacae5ff800 from 11 10000000:01000000:0.0:1790711868.763843:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790711868.763888:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711868.763899:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711868.763911:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711868.763936:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879769984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790711868.764042:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711868.764090:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84fd4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790711868.764214:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879769984 00000100:00100000:2.0:1790711868.764222:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879769984 00000100:00100000:2.0:1790711868.764270:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790711868.764280:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+11:22619:x1877696879769984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790711868.764293:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711868.764308:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0a5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0a58 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711868.764331:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0a58 expref: 12 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711868.764369:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0a58 expref: 12 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711868.764378:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d14a00, rc 0) 00000100:00100000:2.0:1790711868.764423:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22619:x1877696879769984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711868.764429:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790711868.764672:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879769984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790711868.764687:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711868.764707:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711868.764754:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879770112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790711868.764783:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711868.764937:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84fd4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790711868.764983:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879770112 00000100:00100000:2.0:1790711868.764987:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879770112 00000100:00100000:2.0:1790711868.765021:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790711868.765029:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22619:x1877696879770112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790711868.765044:0:22615:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790711868.765061:0:22615:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790711868.765064:0:22615:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1790711868.765148:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:22619:x1877696879770112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711868.765156:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790711868.765186:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879770112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790711868.765224:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790711868.765231:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711868.765240:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790711868.957825:0:22655:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790711868.957834:0:22655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790711868.960822:0:22655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790711868.960836:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790711869.023770:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:0.0:1790711869.532362:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790711869.992355:0:22655:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790711869.992365:0:22655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790711869.992511:0:22655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1790711869.992593:0:22655:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790711869.992823:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1790711870.042725:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:1.0:1790711870.556836:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711871.067785:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:0.0:1790711871.578999:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711872.095619:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00000001:02000400:3.0:1790711872.327476:0:22905:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790711872.610191:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711873.114848:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00000020:00000004:0.0:1790711873.333427:0:22957:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790711873.334498:0:22957:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1790711873.370832:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790711873.370839:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1790711873.370843:0:8:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790711873.370851:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 634 00000100:00080000:1.0:1790711873.370856:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790711873.370869:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9daca0a46800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1790711873.370892:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51d6d80 x1877696879770368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790711873.370905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790711873.370908:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790711873.370911:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790711873.370914:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790711873.370917:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790711873.370920:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790711873.370921:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dab833a7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790711873.370943:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9dab833a7800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1790711873.370956:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51d6680 x1877696879770496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790711873.371297:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879770368:0@lo:38:kworker.0 00000100:00100000:2.0:1790711873.371426:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711873.371482:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877696879770496:0@lo:38:kworker.0 00000100:00100000:2.0:1790711873.371511:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711873.371596:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790711873.371604:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879770240:0@lo:400:kworker.0 00000100:00100000:2.0:1790711873.371648:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711873.371684:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879770240 00000100:00100000:2.0:1790711873.371691:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879770240 00000100:00100000:2.0:1790711873.371751:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790711873.371770:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:3610:x1877696879770240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711873.371820:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:3610:x1877696879770240:12345-0@lo:400:kworker.0 Request processed in 61us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711873.371827:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790711873.371874:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879770240:0@lo:400:kworker.0 00000100:00100000:1.0:1790711873.372631:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879770368 00000100:00100000:1.0:1790711873.372649:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879770368 00000100:00100000:1.0:1790711873.372685:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790711873.372691:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1877696879770368:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790711873.372708:0:22626:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790711873.372768:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1877696879770368:12345-0@lo:38:kworker.0 Request processed in 66us (1333us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790711873.372775:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790711873.373018:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790711873.373024:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790711873.373028:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879770368:0@lo:38:kworker.0 00000100:00100000:0.0:1790711873.373507:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879770496 00000100:00100000:0.0:1790711873.373515:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879770496 00000100:00100000:0.0:1790711873.373567:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790711873.373573:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3606:x1877696879770496:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790711873.373612:0:22623:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 639 last 0 00000020:00000080:0.0:1790711873.373826:0:22623:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcf3cf816241e0a66 00000004:00100000:0.0:1790711873.373842:0:22623:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790711873.373981:0:22623:0:(import.c:65:import_set_state_nolock()) ffff9dacae58a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790711873.374041:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877696879770496:12345-0@lo:38:kworker.0 Request processed in 467us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711873.374048:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790711873.374945:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dacb51d6680 x1877696879770496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790711883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790711873.374963:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790711873.374972:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790711873.374976:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790711873.374979:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab833a7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790711873.374993:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877696879770496:0@lo:38:kworker.0 00010000:00010000:0.0:1790711873.626689:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711874.146074:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00000020:00000004:0.0:1790711874.366525:0:23008:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790711874.367419:0:23008:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790711874.650963:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711875.162934:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:1.0:1790711875.677089:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711876.189859:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:1.0:1790711876.701249:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711877.210634:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00000100:00100000:1.0:1790711877.467047:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711867/real 1790711867] req@ffff9dab838e7800 x1877696879767296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711877 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711877.467074:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dab838e7800 x1877696879767296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711877 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711877.467084:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711867/real 1790711867] req@ffff9dacb51b6d80 x1877696879767168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711877 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711877.467095:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dacb51b6d80 x1877696879767168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711877 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790711877.467110:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790711877.467139:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790711877.467143:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879767296:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790711877.467162:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790711877.467169:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790711877.467172:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879767168:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790711877.467295:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790711877.467299:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790711877.467302:0:8:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790711877.467307:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 639 00000100:00080000:3.0:1790711877.467311:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790711877.467320:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9daca0a46800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711877.467338:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e5180 x1877696879770752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790711877.467351:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711877.467354:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790711877.467356:0:8:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790711877.467359:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:3.0:1790711877.467361:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790711877.467365:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9daca0a46000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711877.467500:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e4a80 x1877696879770880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790711877.467516:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711877.467519:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790711877.467521:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790711877.467524:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:3.0:1790711877.467527:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790711877.467532:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dab81c7d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711877.467900:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e5f80 x1877696879771008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790711877.467957:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877696879771136:0@lo:400:kworker.0 00000100:00100000:0.0:1790711877.468015:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711877.468097:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790711877.468106:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879770624:0@lo:400:kworker.0 00000100:00100000:3.0:1790711877.468140:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711877.468177:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879770624 00000100:00100000:3.0:1790711877.468184:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879770624 00000100:00100000:3.0:1790711877.468225:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790711877.468233:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:3609:x1877696879770624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711877.468279:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:3609:x1877696879770624:12345-0@lo:400:kworker.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711877.468286:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790711877.468326:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879770624:0@lo:400:kworker.0 00000100:00100000:3.0:1790711877.468345:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879770752:0@lo:38:kworker.0 00000100:00100000:3.0:1790711877.468369:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711877.468388:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879770880:0@lo:8:kworker.0 00000400:00000100:3.0:1790711877.468403:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696879770880 offset 0 length 520: 4 00000100:00100000:3.0:1790711877.468413:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879771008:0@lo:8:kworker.0 00000400:00000100:3.0:1790711877.468440:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696879771008 offset 0 length 520: 4 00000100:00100000:3.0:1790711877.468462:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879770752 00000100:00100000:3.0:1790711877.468466:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879770752 00000100:00100000:3.0:1790711877.468485:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790711877.471090:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1877696879770752:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790711877.471115:0:22626:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790711877.471215:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1877696879770752:12345-0@lo:38:kworker.0 Request processed in 147us (2844us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790711877.471223:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1790711877.472254:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790711877.472262:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790711877.472267:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879770752:0@lo:38:kworker.0 00000100:00100000:2.0:1790711877.472743:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879771136 00000100:00100000:2.0:1790711877.472751:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879771136 00000100:00100000:2.0:1790711877.472950:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790711877.472959:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877696879771136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711877.492348:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877696879771136:12345-0@lo:400:kworker.0 Request processed in 19378us (24320us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711877.492363:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790711877.492517:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dab838e4000 x1877696879771136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711877.492555:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877696879771136:0@lo:400:kworker.0 00010000:00010000:1.0:1790711877.735289:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711878.235390:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:0.0:1790711878.752413:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790711879.195853:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790711879.261487:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:1.0:1790711879.771008:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711880.282668:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:0.0:1790711880.795119:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711881.306754:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:2.0:1790711881.818797:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790711882.271778:0:23354:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790711882.271783:0:23354:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1790711882.271785:0:23354:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1790711882.272307:0:23354:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dacb5208000 00000020:01000004:2.0:1790711882.272331:0:23354:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1790711882.272346:0:23354:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790711882.272366:0:23354:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9daca0a219c0) 00000020:00000080:2.0:1790711882.272386:0:23354:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1790711882.331651:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00100000:10000000:2.0:1790711882.363234:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1790711882.366938:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790711882.377399:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.378277:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.380825:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.381954:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.382325:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.382911:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.383374:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.383913:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.385333:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.386500:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.388110:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.388371:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.388902:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.389456:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.390134:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.390363:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.390855:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.391127:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.391320:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.391511:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.392196:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.392393:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.392869:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.393137:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.393329:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.393510:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.395383:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.395940:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.396204:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.396504:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1790711882.396930:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1790711882.397214:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1790711882.408335:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790711882.408827:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1790711882.409280:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1790711882.409490:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1790711882.411144:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790711882.413818:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1790711882.415320:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790711882.416846:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1790711882.417972:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1790711882.419210:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790711882.420147:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790711882.420897:0:23354:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1790711882.424241:0:23354:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790711882.427195:0:23354:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1790711882.427220:0:23354:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790711882.427247:0:23354:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3cf816241e0a74 00000020:01000004:1.0:1790711882.427259:0:23354:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1790711882.427290:0:23354:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790711882.427295:0:23354:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790711882.427303:0:23354:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1790711882.427349:0:23354:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1790711882.427354:0:23354:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1790711882.445503:0:23354:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790711882.445885:0:23354:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.106@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1790711882.445891:0:23354:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790711882.445893:0:23354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790711882.445895:0:23354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790711882.445897:0:23354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790711882.445898:0:23354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790711882.445899:0:23354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790711882.445902:0:23354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790711882.445904:0:23354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790711882.445905:0:23354:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790711882.445911:0:23354:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1790711882.445914:0:23354:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790711882.445915:0:23354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790711882.445916:0:23354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790711882.445917:0:23354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790711882.445918:0:23354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790711882.445919:0:23354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790711882.445920:0:23354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790711882.445921:0:23354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790711882.445922:0:23354:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790711882.445962:0:23354:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790711882.446052:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790711882.446158:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.446264:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dab832eb540 going to sleep for 11 seconds 00000100:00100000:1.0:1790711882.453952:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879771264 00000100:00100000:1.0:1790711882.453974:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879771264 00000100:00100000:0.0:1790711882.457371:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790711882.457389:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:23354:x1877696879771264:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790711882.457444:0:22613:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790711882.457448:0:22613:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1790711882.457457:0:22613:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1790711882.459281:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:23354:x1877696879771264:12345-0@lo:253:mount.lustre.0 Request processed in 1884us (13111us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711882.459297:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790711882.460284:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771264:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790711882.460305:0:23354:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790711882.460310:0:23354:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790711882.460312:0:23354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790711882.460313:0:23354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790711882.460315:0:23354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790711882.460316:0:23354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790711882.460318:0:23354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790711882.460319:0:23354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790711882.460322:0:23354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790711882.460323:0:23354:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790711882.460359:0:23354:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dacb5208000 from lustre-MDT0001 10000000:01000000:0.0:1790711882.460402:0:23354:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1790711882.460405:0:23354:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790711882.460416:0:23354:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9daca0a24d40 local copy 00010000:00010000:0.0:1790711882.460430:0:23354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711882.460595:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711882.460661:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.460721:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dab832eb300 going to sleep for 11 seconds 00000100:00100000:3.0:1790711882.461060:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879771392 00000100:00100000:3.0:1790711882.461070:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879771392 00000100:00100000:3.0:1790711882.461132:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790711882.461144:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:23354:x1877696879771392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790711882.461243:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:23354:x1877696879771392:12345-0@lo:501:mount.lustre.0 Request processed in 102us (583us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790711882.461251:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790711882.461411:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771392:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790711882.461429:0:23354:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790711882.461464:0:23354:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790711882.461472:0:23354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.461483:0:23354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711882.461518:0:23354:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dacb5208000 10000000:01000000:0.0:1790711882.461659:0:23354:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790711882.461666:0:23354:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9daca0a24d40 10000000:01000000:0.0:1790711882.461669:0:23354:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790711882.461673:0:23354:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9daca0a24d40 from 1 10000000:01000000:0.0:1790711882.461676:0:23354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790711882.461850:0:23354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac80031e00/0xcf3cf816241e0a7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.461861:0:23354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dac80031e00/0xcf3cf816241e0a7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.461871:0:23354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dac80031e00/0xcf3cf816241e0a7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711882.461893:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790711882.461933:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.462014:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dab832eb300 going to sleep for 11 seconds 00000100:00100000:1.0:1790711882.462133:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879771520 00000100:00100000:1.0:1790711882.462140:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879771520 00000100:00100000:0.0:1790711882.462238:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790711882.462246:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+12:23354:x1877696879771520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790711882.462259:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711882.462275:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac8167c400/0xcf3cf816241e0a82 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0a7b expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.462309:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac8167c400/0xcf3cf816241e0a82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0a7b expref: 13 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.462322:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac8167c400/0xcf3cf816241e0a82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0a7b expref: 13 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.462333:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac8167c400, rc 0) 00000100:00100000:0.0:1790711882.462374:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+13:23354:x1877696879771520:12345-0@lo:101:mount.lustre.0 Request processed in 129us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711882.462382:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790711882.462493:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790711882.462509:0:23354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dac80031e00/0xcf3cf816241e0a7b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a82 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711882.462564:0:23354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dac80031e00/0xcf3cf816241e0a7b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0a82 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711882.462584:0:23354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1790711882.462596:0:23354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac80031e00/0xcf3cf816241e0a7b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a82 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711882.462604:0:23354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dac80031e00/0xcf3cf816241e0a7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a82 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711882.462614:0:23354:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9dacb5208000 10000000:01000000:2.0:1790711882.462618:0:23354:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790711882.462623:0:23354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9dacb5208000 from 1 10000000:01000000:2.0:1790711882.462625:0:23354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790711882.462644:0:23354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711882.462651:0:23354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711882.462658:0:23354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711882.462673:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790711882.462973:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.463013:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac88023000 going to sleep for 11 seconds 00000100:00100000:0.0:1790711882.463120:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879771648 00000100:00100000:0.0:1790711882.463125:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879771648 00000100:00100000:0.0:1790711882.463160:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790711882.463168:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+13:23354:x1877696879771648:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790711882.463178:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711882.463188:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac8167ca00/0xcf3cf816241e0a90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0a89 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.463207:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac8167ca00/0xcf3cf816241e0a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0a89 expref: 14 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.463217:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac8167ca00/0xcf3cf816241e0a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0a89 expref: 14 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.463224:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac8167ca00, rc 0) 00000100:00100000:0.0:1790711882.463264:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+14:23354:x1877696879771648:12345-0@lo:101:mount.lustre.0 Request processed in 96us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711882.463270:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790711882.463387:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790711882.463400:0:23354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a90 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711882.463415:0:23354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0a90 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711882.463431:0:23354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790711882.463446:0:23354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a90 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711882.463454:0:23354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d14c00/0xcf3cf816241e0a89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a90 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711882.463461:0:23354:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1790711882.463466:0:23354:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790711882.463472:0:23354:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9dacb5208000 10000000:01000000:2.0:1790711882.463475:0:23354:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790711882.463479:0:23354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1790711882.463481:0:23354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1790711882.463502:0:23354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15000/0xcf3cf816241e0a97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711882.463509:0:23354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d15000/0xcf3cf816241e0a97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711882.463516:0:23354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d15000/0xcf3cf816241e0a97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711882.463897:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771776:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790711882.463940:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.463971:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac88023000 going to sleep for 11 seconds 00000100:00100000:1.0:1790711882.464094:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879771776 00000100:00100000:1.0:1790711882.464101:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879771776 00000100:00100000:1.0:1790711882.464146:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790711882.464156:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+14:23354:x1877696879771776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790711882.464168:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711882.464182:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacbcb74400/0xcf3cf816241e0a9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0a97 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.464202:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb74400/0xcf3cf816241e0a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0a97 expref: 15 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.464211:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacbcb74400/0xcf3cf816241e0a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0a97 expref: 15 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.464220:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacbcb74400, rc 0) 00000100:00100000:1.0:1790711882.464266:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+15:23354:x1877696879771776:12345-0@lo:101:mount.lustre.0 Request processed in 112us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711882.464273:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790711882.464359:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771776:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790711882.464372:0:23354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d15000/0xcf3cf816241e0a97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a9e expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711882.464381:0:23354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d15000/0xcf3cf816241e0a97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0a9e expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790711882.469237:0:23354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1790711882.470407:0:23354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790711882.475104:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1790711882.475188:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1790711882.475205:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1790711882.475221:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1790711882.475236:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1790711882.475249:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1790711882.475263:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1790711882.475278:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1790711882.475294:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1790711882.475307:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1790711882.475324:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1790711882.475338:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1790711882.475350:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1790711882.475364:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1790711882.475378:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1790711882.475394:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1790711882.475411:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1790711882.475426:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1790711882.475440:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1790711882.475452:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1790711882.475465:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1790711882.475480:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1790711882.475493:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1790711882.475508:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1790711882.475655:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1790711882.475676:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1790711882.475706:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1790711882.475722:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1790711882.475738:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1790711882.475750:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1790711882.475764:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1790711882.475792:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1790711882.475807:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1790711882.475822:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1790711882.475835:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1790711882.475850:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1790711882.475863:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1790711882.475876:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1790711882.475892:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1790711882.475907:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1790711882.475921:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1790711882.475933:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1790711882.475945:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1790711882.475957:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1790711882.475990:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1790711882.475995:0:23354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1790711882.476158:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711882.476252:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.476299:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca014a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790711882.477092:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879771904 00000100:00100000:1.0:1790711882.477106:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879771904 00000100:00100000:1.0:1790711882.477207:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790711882.477220:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+15:23354:x1877696879771904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790711882.477470:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+15:23354:x1877696879771904:12345-0@lo:501:mount.lustre.0 Request processed in 251us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711882.477493:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790711882.477753:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879771904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790711882.477819:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879772032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790711882.477875:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.478136:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84010a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790711882.478220:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879772032 00000100:00100000:0.0:1790711882.478226:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879772032 00000100:00100000:3.0:1790711882.478394:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790711882.478411:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+15:23354:x1877696879772032:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790711882.479441:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+15:23354:x1877696879772032:12345-0@lo:503:mount.lustre.0 Request processed in 1022us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711882.479452:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790711882.479859:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879772032:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790711882.480420:0:23354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790711882.483281:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879772160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790711882.483982:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.484040:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84010a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790711882.484195:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879772160 00000100:00100000:3.0:1790711882.484206:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879772160 00000100:00100000:3.0:1790711882.484310:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790711882.484321:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+15:23354:x1877696879772160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790711882.485612:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+15:23354:x1877696879772160:12345-0@lo:502:mount.lustre.0 Request processed in 1283us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711882.485627:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790711882.485856:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879772160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790711882.486170:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790711882.486210:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1790711882.486227:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1790711882.486240:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1790711882.486253:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1790711882.486267:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1790711882.486284:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1790711882.486298:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1790711882.486310:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1790711882.486323:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1790711882.486348:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1790711882.486362:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1790711882.486376:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1790711882.486390:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1790711882.486401:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1790711882.486413:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1790711882.486426:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1790711882.486438:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1790711882.486451:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1790711882.486464:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1790711882.486479:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1790711882.486493:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1790711882.486507:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1790711882.486520:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1790711882.486531:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1790711882.486572:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1790711882.486588:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1790711882.486601:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1790711882.486615:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1790711882.486629:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1790711882.486641:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1790711882.486654:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1790711882.486668:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1790711882.486681:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1790711882.486847:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1790711882.486864:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1790711882.486879:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1790711882.486893:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1790711882.486905:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1790711882.486917:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1790711882.486928:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1790711882.486938:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1790711882.486952:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1790711882.486978:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1790711882.487036:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879772288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790711882.487137:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.488061:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84010a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790711882.488152:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879772288 00000100:00100000:1.0:1790711882.488162:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879772288 00000100:00100000:0.0:1790711882.488365:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790711882.488376:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+15:23354:x1877696879772288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790711882.498823:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+15:23354:x1877696879772288:12345-0@lo:502:mount.lustre.0 Request processed in 10429us (11666us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711882.498849:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790711882.499150:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879772288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790711882.499292:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1790711882.499312:0:23354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1790711882.500922:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790711882.500941:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711882.500944:0:23358:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1790711882.500951:0:23358:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1790711882.500955:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790711882.500976:0:23358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9dacb131b380) 00000020:00000080:3.0:1790711882.501006:0:23358:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1790711882.501014:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790711882.501117:0:23358:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790711882.501126:0:23358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3cf816241e0aac 00000020:00000080:3.0:1790711882.501375:0:23358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1790711882.501381:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790711882.501385:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711882.501386:0:23358:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1790711882.501400:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790711882.501404:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711882.501405:0:23358:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1790711882.501409:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790711882.501417:0:23358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9dacb1318000) 00000020:00000080:3.0:1790711882.501429:0:23358:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1790711882.501435:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790711882.501437:0:23358:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1790711882.501441:0:23358:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1790711882.501447:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790711882.501512:0:23358:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dacb5208000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1790711882.501855:0:23358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9dacb131cd40) 00000020:00000080:3.0:1790711882.501867:0:23358:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1790711882.501950:0:23358:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790711882.501957:0:23358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3cf816241e0ac1 00000020:00000080:3.0:1790711882.502283:0:23358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1790711882.502293:0:23358:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790711882.502298:0:23358:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcf3cf816241e0ac8 00080000:01000000:3.0:1790711882.502306:0:23358:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790711882.502311:0:23358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3cf816241e0acf 00000100:00080000:2.0:1790711882.588240:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790711882.588253:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790711882.588258:0:8:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790711882.588267:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 643 00000100:00080000:2.0:1790711882.588272:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1790711882.588287:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9daca0a46800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1790711882.588330:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab8329c000 x1877696879772416/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790711882.588354:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711882.588358:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790711882.588360:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711882.588363:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790711882.588428:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790711882.588445:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877696879772544:0@lo:400:kworker.0 00000100:00100000:2.0:1790711882.588518:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.588590:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879772544 00000100:00100000:2.0:1790711882.588599:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879772544 00000100:00100000:2.0:1790711882.588652:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790711882.588662:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877696879772544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711882.588726:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877696879772544:12345-0@lo:400:kworker.0 Request processed in 64us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711882.588750:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790711882.588803:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9dab8329fb80 x1877696879772544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711882.588820:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877696879772544:0@lo:400:kworker.0 00000100:00100000:1.0:1790711882.588865:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879772416:0@lo:38:kworker.0 00000100:00100000:1.0:1790711882.588951:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.589509:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879772416 00000100:00100000:2.0:1790711882.589517:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879772416 00000100:00100000:2.0:1790711882.589590:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790711882.589596:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1877696879772416:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1790711882.589616:0:22626:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:2.0:1790711882.608458:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1877696879772416:12345-0@lo:38:kworker.0 Request processed in 18845us (19491us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790711882.608478:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790711882.608747:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790711882.608755:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790711882.608760:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879772416:0@lo:38:kworker.0 00010000:00010000:0.0:1790711882.642939:0:23358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1790711882.645412:0:23358:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1790711882.660083:0:23358:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790711882.664571:0:23358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1790711882.664589:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711882.664599:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.664611:0:23358:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1790711882.664616:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790711882.664623:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.664625:0:23358:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1790711882.664628:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790711882.664634:0:23358:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000020:00000080:0.0:1790711882.664667:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790711882.664683:0:23358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9dacb52d99c0) 00000020:00000080:0.0:1790711882.664717:0:23358:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1790711882.664724:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790711882.677042:0:23358:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1790711882.677066:0:23358:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790711882.677079:0:23358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3cf816241e0add 00010000:00080000:3.0:1790711882.677116:0:23358:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dacbfbbf800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1790711882.684707:0:23358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1790711882.691741:0:23358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790711882.691757:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1790711882.691798:0:23358:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790711882.691824:0:23358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3cf816241e0ae4 00000100:00080000:0.0:1790711882.691834:0:23358:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790711882.691848:0:23358:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9dacbfbbf800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711882.691892:0:23358:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b4000 x1877696879772672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790711882.691919:0:23358:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1790711882.691979:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711882.691983:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.691985:0:23358:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1790711882.691988:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790711882.691990:0:23358:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1790711882.691992:0:23358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790711882.691993:0:23358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790711882.691995:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790711882.691997:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.691999:0:23358:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790711882.692001:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790711882.692006:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.692007:0:23358:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1790711882.692033:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790711882.692070:0:23358:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790711882.692085:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711882.692088:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.692090:0:23358:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1790711882.692093:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790711882.692094:0:23358:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1790711882.692095:0:23358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790711882.692097:0:23358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790711882.692098:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790711882.692101:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.692103:0:23358:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790711882.692105:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790711882.692108:0:23358:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790711882.692112:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.692125:0:23358:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790711882.692129:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790711882.692133:0:23358:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000020:01000000:0.0:1790711882.692154:0:23358:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790711882.692156:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790711882.692169:0:23358:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9dacb52dcd40) 00000020:00000080:0.0:1790711882.692181:0:23358:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1790711882.692186:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790711882.692243:0:23358:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1790711882.692251:0:23358:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790711882.692256:0:23358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3cf816241e0af2 00010000:00080000:0.0:1790711882.692285:0:23358:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dacb520e800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.106@tcp at head 00010000:00010000:0.0:1790711882.692699:0:23358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1790711882.694022:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879772672:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790711882.694145:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711882.694220:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879772672 00000100:00100000:3.0:1790711882.694235:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879772672 00000100:00100000:3.0:1790711882.694290:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790711882.694299:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3606:x1877696879772672:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790711882.694335:0:22627:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:3.0:1790711882.694380:0:22627:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3cf816241e0af9 00000004:00100000:3.0:1790711882.694396:0:22627:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790711882.694402:0:22627:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:2.0:1790711882.694498:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711882.694506:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790711882.694509:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711882.694512:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:3.0:1790711882.696387:0:23358:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1790711882.696993:0:23358:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1790711882.698762:0:23358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790711882.700398:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1790711882.701871:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1790711882.704403:0:23363:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790711882.704411:0:23363:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1790711882.708055:0:22627:0:(import.c:65:import_set_state_nolock()) ffff9daca0103000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790711882.708183:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3606:x1877696879772672:12345-0@lo:38:llog_process_th.0 Request processed in 13882us (14036us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711882.708195:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790711882.709962:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790711882.709986:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1790711882.709999:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1790711882.710008:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790711882.710013:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacbfbbf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790711882.710049:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879772672:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790711882.710583:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879772800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790711882.710680:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.711648:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879772800 00000100:00100000:2.0:1790711882.711660:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879772800 00000100:00100000:2.0:1790711882.711733:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790711882.711752:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1877696879772800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790711882.711790:0:22626:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790711882.711881:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3609:x1877696879772800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711882.711889:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790711882.713678:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879772800:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1790711882.714446:0:23358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790711882.714462:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790711882.714512:0:23358:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790711882.714535:0:23358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3cf816241e0b00 00000100:00080000:2.0:1790711882.714581:0:23358:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790711882.714593:0:23358:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dacb520e800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1790711882.714635:0:23358:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab8329fb80 x1877696879772928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790711882.714664:0:23358:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790711882.714737:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790711882.714742:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711882.714744:0:23358:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790711882.714747:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790711882.714749:0:23358:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1790711882.714751:0:23358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790711882.714752:0:23358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790711882.714754:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790711882.714756:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711882.714758:0:23358:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790711882.714760:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790711882.714765:0:23358:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1790711882.714769:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711882.714770:0:23358:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790711882.714774:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790711882.714778:0:23358:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.106@tcp to nid 0x20000c0a8cb6a (192.168.203.106@tcp) 00000100:00100000:3.0:1790711882.714908:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879772928:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790711882.714914:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790711882.714926:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790711882.714929:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790711882.714932:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000400:00000100:3.0:1790711882.714993:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696879772928 offset 0 length 520: 4 00000020:01000000:2.0:1790711882.715055:0:23358:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1790711882.715060:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790711882.715074:0:23358:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9daca0a20000) 00000020:00000080:2.0:1790711882.715090:0:23358:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1790711882.715095:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790711882.715166:0:23358:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1790711882.715173:0:23358:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790711882.715180:0:23358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3cf816241e0b0e 00010000:00080000:2.0:1790711882.715211:0:23358:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dacb520d000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.106@tcp at head 00010000:00010000:2.0:1790711882.715440:0:23358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1790711882.715509:0:23358:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790711882.715527:0:23358:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1790711882.723988:0:23358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790711882.724757:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1790711882.725021:0:23358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1790711882.726626:0:23365:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790711882.726635:0:23365:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790711882.732407:0:23358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790711882.732432:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790711882.732504:0:23358:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790711882.732592:0:23358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3cf816241e0b15 00000100:00080000:0.0:1790711882.732607:0:23358:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790711882.732623:0:23358:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dacb520d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711882.732676:0:23358:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b7b80 x1877696879773056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790711882.733018:0:23358:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790711882.733176:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711882.733181:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.733183:0:23358:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790711882.733187:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790711882.733193:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.733194:0:23358:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790711882.733198:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790711882.733200:0:23358:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790711882.733203:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711882.733216:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.733218:0:23358:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790711882.733221:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790711882.733224:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.733225:0:23358:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790711882.733231:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790711882.733289:0:23358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711882.733293:0:23358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711882.733295:0:23358:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790711882.733298:0:23358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1790711882.733378:0:23354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1790711882.733417:0:23354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1790711882.733438:0:23354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15000/0xcf3cf816241e0a97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a9e expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.733451:0:23354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d15000/0xcf3cf816241e0a97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0a9e expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711882.733460:0:23354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dacb5208000 from 1 10000000:01000000:0.0:1790711882.733463:0:23354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790711882.733502:0:23354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.733510:0:23354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.733535:0:23354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711882.733585:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790711882.733678:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711882.734875:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879773056:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790711882.734945:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696879773056 offset 0 length 520: 4 00000100:00100000:0.0:1790711882.735287:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8690e540 going to sleep for 11 seconds 00000100:00100000:3.0:1790711882.736484:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879773184 00000100:00100000:3.0:1790711882.736500:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879773184 00000100:00100000:3.0:1790711882.736598:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790711882.736609:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+15:23354:x1877696879773184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790711882.736630:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711882.736664:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab82d12000/0xcf3cf816241e0b23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0b1c expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711882.736721:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab82d12000/0xcf3cf816241e0b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0b1c expref: 16 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711882.736734:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab82d12000/0xcf3cf816241e0b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b1c expref: 16 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711882.736745:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d12000, rc 0) 00000100:00100000:3.0:1790711882.736839:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+16:23354:x1877696879773184:12345-0@lo:101:mount.lustre.0 Request processed in 232us (3161us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711882.736847:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790711882.737197:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790711882.737290:0:23354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.737314:0:23354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711882.739192:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773312:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1790711882.740138:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.740260:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8690e540 going to sleep for 11 seconds 00000100:00080000:3.0:1790711882.743393:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711882.743406:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711882.743409:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711882.743420:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790711882.750170:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879773312 00000100:00100000:1.0:1790711882.750191:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879773312 00000100:00100000:1.0:1790711882.750402:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790711882.751317:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+16:23354:x1877696879773312:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790711882.751355:0:22614:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790711882.751385:0:22614:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790711882.751388:0:22614:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1790711882.752409:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+16:23354:x1877696879773312:12345-0@lo:256:mount.lustre.0 Request processed in 1988us (12269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711882.752433:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790711882.752677:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773312:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790711882.754621:0:23354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790711882.754862:0:23354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.754879:0:23354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711882.754890:0:23354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dacb5208000 from 1 10000000:01000000:0.0:1790711882.754894:0:23354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790711882.754953:0:23354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.754964:0:23354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.754979:0:23354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711882.755017:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790711882.755107:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.755173:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8690e540 going to sleep for 11 seconds 00000100:00100000:1.0:1790711882.755730:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879773440 00000100:00100000:1.0:1790711882.755742:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879773440 00000100:00100000:1.0:1790711882.755812:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790711882.755822:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+16:23354:x1877696879773440:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790711882.755854:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711882.755873:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0b31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0b2a expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.755906:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0b2a expref: 17 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.755920:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b2a expref: 17 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.755931:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacbcb75400, rc 0) 00000100:00100000:1.0:1790711882.756000:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:23354:x1877696879773440:12345-0@lo:101:mount.lustre.0 Request processed in 179us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711882.756008:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790711882.756335:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790711882.756355:0:23354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.756365:0:23354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790711882.762461:0:23354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1790711882.767262:0:23354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790711882.767606:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1790711882.767639:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1790711882.767655:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1790711882.767669:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1790711882.767680:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1790711882.767717:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1790711882.767733:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1790711882.767747:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1790711882.767761:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1790711882.767773:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1790711882.767784:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1790711882.767803:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1790711882.767809:0:23354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1790711882.767941:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711882.768028:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.768072:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8690e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790711882.768909:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879773568 00000100:00100000:1.0:1790711882.768924:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879773568 00000100:00100000:1.0:1790711882.769009:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790711882.769022:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:23354:x1877696879773568:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790711882.769248:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:23354:x1877696879773568:12345-0@lo:501:mount.lustre.0 Request processed in 229us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711882.769257:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790711882.770233:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790711882.770307:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790711882.777649:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.777789:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879773696 00000100:00100000:0.0:1790711882.777807:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879773696 00000100:00100000:3.0:1790711882.777876:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84010780 going to sleep for 11 seconds 00000100:00100000:0.0:1790711882.777915:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790711882.777930:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:23354:x1877696879773696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790711882.778185:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:23354:x1877696879773696:12345-0@lo:503:mount.lustre.0 Request processed in 259us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711882.778194:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790711882.778310:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773696:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790711882.778867:0:23354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790711882.778961:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790711882.779028:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711882.779068:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac83fa9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790711882.779597:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879773824 00000100:00100000:0.0:1790711882.779611:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879773824 00000100:00100000:0.0:1790711882.779676:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790711882.779697:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:23354:x1877696879773824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790711882.779896:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:23354:x1877696879773824:12345-0@lo:502:mount.lustre.0 Request processed in 210us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711882.779904:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790711882.780621:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790711882.781016:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1790711882.781056:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1790711882.781073:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1790711882.781089:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1790711882.781105:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1790711882.781119:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1790711882.781430:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1790711882.781444:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1790711882.781457:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1790711882.781470:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1790711882.781482:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1790711882.781531:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790711882.781649:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711882.782336:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca0a0db40 going to sleep for 11 seconds 00000100:00100000:2.0:1790711882.784821:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879773952 00000100:00100000:2.0:1790711882.784844:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879773952 00000100:00100000:3.0:1790711882.785114:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790711882.785130:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:23354:x1877696879773952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790711882.785358:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:23354:x1877696879773952:12345-0@lo:502:mount.lustre.0 Request processed in 230us (3708us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711882.785374:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790711882.785679:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879773952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790711882.785819:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1790711882.785837:0:23354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1790711882.787104:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790711882.787123:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711882.787136:0:23367:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790711882.787146:0:23367:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dacb5208000 00000020:00000080:3.0:1790711882.787149:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790711882.787160:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790711882.787162:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711882.787164:0:23367:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790711882.787166:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790711882.787168:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711882.787169:0:23367:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790711882.787172:0:23367:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dacb5208000 00000020:00000080:3.0:1790711882.787174:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790711882.787242:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790711882.787246:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711882.787247:0:23367:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790711882.787250:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790711882.787252:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711882.787253:0:23367:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790711882.787256:0:23367:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dacb5208000 00000020:00000080:3.0:1790711882.787258:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790711882.787276:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790711882.787279:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711882.787280:0:23367:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790711882.787283:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790711882.787285:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711882.787286:0:23367:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790711882.787289:0:23367:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dacb5208000 00000020:00000080:3.0:1790711882.787291:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790711882.787321:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790711882.787323:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711882.787336:0:23367:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790711882.787339:0:23367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1790711882.787498:0:23354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790711882.787576:0:23354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790711882.787605:0:23354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.787620:0:23354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711882.787686:0:23354:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790711882.787701:0:23354:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dacb5208000 10000000:01000000:0.0:1790711882.787705:0:23354:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dacb5208000 10000000:01000000:0.0:1790711882.787710:0:23354:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790711882.787719:0:23354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dacb5208000 from 1 10000000:01000000:0.0:1790711882.787721:0:23354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790711882.787769:0:23354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e0b38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.787778:0:23354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e0b38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.787798:0:23354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e0b38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711882.787830:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790711882.787929:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.787982:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8407de40 going to sleep for 11 seconds 00000100:00100000:3.0:1790711882.788254:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879774080 00000100:00100000:3.0:1790711882.788265:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879774080 00000100:00100000:3.0:1790711882.788321:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790711882.788332:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:23354:x1877696879774080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790711882.788349:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711882.788366:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab82d12a00/0xcf3cf816241e0b3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0b38 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711882.788397:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab82d12a00/0xcf3cf816241e0b3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0b38 expref: 18 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711882.788410:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab82d12a00/0xcf3cf816241e0b3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b38 expref: 18 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711882.788419:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d12a00, rc 0) 00000100:00100000:3.0:1790711882.788472:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774080:12345-0@lo:101:mount.lustre.0 Request processed in 142us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711882.788480:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790711882.791351:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790711882.791389:0:23354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e0b38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b3f expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711882.791402:0:23354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e0b38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0b3f expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790711882.796489:0:23354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1790711882.796976:0:23354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790711882.797219:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1790711882.797246:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1790711882.797259:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1790711882.797272:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1790711882.797283:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1790711882.797295:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1790711882.797308:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1790711882.797320:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1790711882.797332:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1790711882.797342:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1790711882.797355:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1790711882.797368:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1790711882.797385:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1790711882.797398:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1790711882.797409:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1790711882.797423:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1790711882.797435:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1790711882.797447:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1790711882.797470:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1790711882.797483:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1790711882.797511:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1790711882.797525:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1790711882.797536:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1790711882.797582:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1790711882.797598:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1790711882.797611:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1790711882.797624:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1790711882.797636:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1790711882.797650:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1790711882.797664:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1790711882.797677:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1790711882.797702:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1790711882.797719:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1790711882.797734:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1790711882.797746:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1790711882.797759:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1790711882.797787:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1790711882.797800:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1790711882.797812:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1790711882.797823:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1790711882.797834:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1790711882.797845:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1790711882.797857:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1790711882.797869:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1790711882.797883:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1790711882.797896:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1790711882.797909:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1790711882.797922:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1790711882.798059:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1790711882.798078:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1790711882.798097:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1790711882.798110:0:23354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1790711882.798226:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790711882.800512:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.800742:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879774208 00000100:00100000:0.0:1790711882.800756:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879774208 00000100:00100000:0.0:1790711882.800825:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790711882.800839:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711882.801069:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774208:12345-0@lo:501:mount.lustre.0 Request processed in 234us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711882.801079:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790711882.801150:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca0a0db40 going to sleep for 11 seconds 00000100:00100000:0.0:1790711882.801182:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711882.801266:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790711882.801328:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.808782:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8407d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790711882.809817:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879774336 00000100:00100000:2.0:1790711882.811319:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879774336 00000100:00100000:2.0:1790711882.811408:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790711882.811421:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774336:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790711882.813082:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774336:12345-0@lo:503:mount.lustre.0 Request processed in 1648us (11739us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711882.813097:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790711882.815657:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774336:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790711882.830012:0:23354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790711882.830506:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790711882.830653:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711882.830889:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8407de40 going to sleep for 11 seconds 00000100:00100000:2.0:1790711882.832727:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879774464 00000100:00100000:2.0:1790711882.832746:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879774464 00000100:00100000:2.0:1790711882.832825:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790711882.832837:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790711882.833055:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774464:12345-0@lo:502:mount.lustre.0 Request processed in 220us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711882.833065:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790711882.833631:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790711882.834063:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1790711882.834100:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1790711882.834115:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1790711882.836787:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1790711882.836858:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1790711882.836874:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1790711882.836887:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1790711882.836900:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1790711882.836912:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1790711882.836924:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1790711882.836935:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1790711882.836947:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1790711882.836958:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1790711882.836970:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1790711882.836985:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1790711882.837000:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1790711882.837016:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1790711882.837048:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1790711882.837065:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1790711882.837078:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1790711882.837091:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1790711882.837102:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1790711882.837114:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1790711882.839647:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1790711882.839744:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1790711882.840824:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1790711882.840861:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1790711882.840878:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1790711882.840892:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1790711882.840904:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1790711882.840916:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1790711882.840929:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1790711882.840941:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1790711882.840971:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1790711882.840986:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1790711882.840999:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1790711882.841012:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1790711882.841028:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1790711882.841044:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1790711882.841059:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1790711882.841074:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1790711882.841089:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1790711882.841104:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1790711882.841118:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00010000:00010000:1.0:1790711882.852203:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790711882.862563:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1790711882.862617:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1790711882.862632:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1790711882.862645:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1790711882.862765:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790711882.862880:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.862943:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879774592 00000100:00100000:2.0:1790711882.862954:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879774592 00000100:00100000:2.0:1790711882.863012:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790711882.863022:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790711882.863477:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774592:12345-0@lo:502:mount.lustre.0 Request processed in 454us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711882.863497:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790711882.863652:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84010780 going to sleep for 11 seconds 00000100:00100000:2.0:1790711882.864428:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790711882.864988:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1790711882.865024:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1790711882.865078:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790711882.867112:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.867280:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84010780 going to sleep for 11 seconds 00000100:00100000:0.0:1790711882.869269:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879774720 00000100:00100000:0.0:1790711882.869292:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879774720 00000100:00100000:0.0:1790711882.870279:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790711882.870297:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790711882.870566:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774720:12345-0@lo:502:mount.lustre.0 Request processed in 274us (3461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711882.870577:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790711882.871839:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790711882.871980:0:23354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1790711882.871999:0:23354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790711882.880318:0:23372:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1790711882.880345:0:23372:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9daca73099c0) 00000020:00000080:0.0:1790711882.880375:0:23372:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1790711882.880521:0:23372:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dacb5208000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790711882.880526:0:23372:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dacb5208000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790711882.880529:0:23372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dacb5208000 3 00010000:00080000:0.0:1790711882.880597:0:23372:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dacbf956800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.106@tcp at head 00010000:00010000:0.0:1790711882.906728:0:23372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1790711882.906976:0:23372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1790711882.907026:0:23372:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790711882.907045:0:23372:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcf3cf816241e0b4d 00000100:00080000:0.0:1790711882.907056:0:23372:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790711882.907067:0:23372:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9dacbf956800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711882.907102:0:23372:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b7100 x1877696879774848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790711882.907156:0:23372:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790711882.907376:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877696879774848:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790711882.907472:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790711882.908430:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711882.908438:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711882.908442:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711882.908445:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790711882.910701:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879774848 00000100:00100000:0.0:1790711882.910718:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879774848 00000100:00100000:0.0:1790711882.910779:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790711882.910790:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1877696879774848:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790711882.910820:0:22622:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:0.0:1790711882.910859:0:22622:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcf3cf816241e0b54 00000004:00100000:0.0:1790711882.910874:0:22622:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790711882.910910:0:22622:0:(import.c:65:import_set_state_nolock()) ffff9dac8393b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790711882.911003:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877696879774848:12345-0@lo:38:llog_process_th.0 Request processed in 213us (3530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711882.911012:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790711882.911071:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dacb51b7100 x1877696879774848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790711892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711882.911084:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790711882.911093:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1790711882.911102:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790711882.911107:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790711882.911109:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacbf956800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790711882.911116:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877696879774848:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1790711882.911257:0:23372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1790711882.912375:0:23354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790711882.912430:0:23354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790711882.912462:0:23354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e0b38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b3f expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711882.912496:0:23354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dac8167d000/0xcf3cf816241e0b38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b3f expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790711882.912769:0:23354:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790711882.912772:0:23354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790711882.912774:0:23354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790711882.912775:0:23354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790711882.912776:0:23354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790711882.912778:0:23354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790711882.912780:0:23354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790711882.912782:0:23354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790711882.912784:0:23354:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790711882.912789:0:23354:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1790711882.912791:0:23354:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790711882.912793:0:23354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790711882.912794:0:23354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790711882.912795:0:23354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790711882.912796:0:23354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790711882.912798:0:23354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790711882.912798:0:23354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790711882.912800:0:23354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790711882.912801:0:23354:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790711882.912834:0:23354:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1790711882.912858:0:23354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774976:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790711882.915398:0:23354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711882.915479:0:23354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac90e016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790711882.915605:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879774976 00000100:00100000:0.0:1790711882.915620:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879774976 00000100:00100000:0.0:1790711882.915686:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790711882.915711:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774976:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790711882.915765:0:22613:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790711882.915781:0:22613:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1790711882.922798:0:22601:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1790711882.923076:0:22613:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790711882.923094:0:22613:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1790711882.923804:0:22637:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790711882.923811:0:22637:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790711882.923842:0:22637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.923867:0:22637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0a58 expref: 18 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.923876:0:22637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dab82d12000/0xcf3cf816241e0b23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b1c expref: 18 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.923885:0:22637:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.923935:0:22637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dab82d12000/0xcf3cf816241e0b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0b1c expref: 18 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.923951:0:22637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dab82d12000/0xcf3cf816241e0b23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0b1c expref: 18 pid: 22615 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711882.923968:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879775104:0@lo:104: 00000100:00100000:1.0:1790711882.924060:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790711882.924126:0:22637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0a58 expref: 18 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711882.924632:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:23354:x1877696879774976:12345-0@lo:253:mount.lustre.0 Request processed in 8923us (9242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711882.924647:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790711882.925609:0:23354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:23354:1877696879774976:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790711882.925628:0:23354:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790711882.925632:0:23354:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790711882.925634:0:23354:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790711882.925635:0:23354:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790711882.925636:0:23354:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790711882.925637:0:23354:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790711882.925639:0:23354:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790711882.925641:0:23354:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790711882.925643:0:23354:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790711882.925644:0:23354:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1790711882.925802:0:22637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0a5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0a58 expref: 17 pid: 22614 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711882.925840:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879775232:0@lo:104: 00000100:00100000:1.0:1790711882.925902:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711882.925943:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac86357900 going to sleep for 11 seconds 00000100:00100000:1.0:1790711882.925985:0:22605:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879775104 00000100:00100000:1.0:1790711882.925993:0:22605:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879775104 00000100:00100000:1.0:1790711882.926031:0:22605:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879775232 00000100:00100000:1.0:1790711882.926034:0:22605:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879775232 00000100:00100000:1.0:1790711882.926050:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790711882.926059:0:22605:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+4:22637:x1877696879775104:12345-0@lo:104: 00010000:00010000:1.0:1790711882.926078:0:22605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.926155:0:22605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790711882.926161:0:22605:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+4:22637:x1877696879775104:12345-0@lo:104: Request processed in 104us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711882.926169:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790711882.926187:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790711882.926193:0:22605:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:22637:x1877696879775232:12345-0@lo:104: 00010000:00010000:1.0:1790711882.926201:0:22605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.926237:0:22605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000020:02000000:0.0:1790711882.926417:0:23354:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790711882.927022:0:22605:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:22637:x1877696879775232:12345-0@lo:104: Request processed in 50us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711882.927033:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790711882.927089:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879775104:0@lo:104: 00000100:00100000:1.0:1790711882.927118:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879775232:0@lo:104: 00010000:00010000:1.0:1790711882.927142:0:22637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927166:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790711882.927174:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927182:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167da00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:1.0:1790711882.927187:0:22610:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927199:0:22610:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790711882.927207:0:22610:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790711882.927214:0:22610:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790711882.927274:0:22610:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927282:0:22610:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790711882.927307:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927315:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac8167da00/0xcf3cf816241e0b1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b23 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927331:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790711882.927354:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927361:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac80031c00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:1.0:1790711882.927364:0:22610:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927371:0:22610:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790711882.927377:0:22610:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790711882.927383:0:22610:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790711882.927398:0:22610:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927404:0:22610:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790711882.927423:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927429:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac80031c00/0xcf3cf816241e0a58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0a5f expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927444:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711882.927446:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711882.927447:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711882.927465:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711882.927490:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879775360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790711882.927566:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711882.927640:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bc8ed208-5edc-469a-a5f9-449dbe325e20:3607:1877696879775488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790711882.927678:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711882.927748:0:22607:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879775360 00000100:00100000:1.0:1790711882.927755:0:22607:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879775360 00010000:00010000:1.0:1790711882.927781:0:22607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dab82d12000/0xcf3cf816241e0b23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b1c expref: 18 pid: 22615 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711882.927809:0:22607:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879775488 00000100:00100000:1.0:1790711882.927813:0:22607:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879775488 00010000:00010000:1.0:1790711882.927826:0:22607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0a5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0a58 expref: 19 pid: 22614 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711882.927840:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790711882.927850:0:22607:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:3610:x1877696879775360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790711882.927866:0:22607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790711882.927872:0:22607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dab82d12000/0xcf3cf816241e0b23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b1c expref: 19 pid: 22615 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927883:0:22607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dab82d12000/0xcf3cf816241e0b23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0b1c expref: 19 pid: 22615 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927901:0:22607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d12000/0xcf3cf816241e0b23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0b1c expref: 19 pid: 22615 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.927915:0:22607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790711882.927924:0:22606:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1790711882.927938:0:22606:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1790711882.927957:0:22607:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:3610:x1877696879775360:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711882.927965:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790711882.927984:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790711882.927990:0:22607:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:3607:x1877696879775488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790711882.928005:0:22607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790711882.928010:0:22607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0a5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0a58 expref: 17 pid: 22614 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928020:0:22607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0a58 expref: 17 pid: 22614 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928028:0:22607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0a5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0a58 expref: 17 pid: 22614 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928040:0:22607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928049:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790711882.928063:0:22607:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004252318s 00010000:00010000:1.0:1790711882.928068:0:22607:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928075:0:22607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928082:0:22607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928088:0:22607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928093:0:22607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb74200 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711882.928097:0:22607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928112:0:22607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928127:0:22607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928137:0:22607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790711882.928163:0:22607:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+16:3607:x1877696879775488:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711882.928169:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790711882.928204:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879775360:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790711882.928223:0:22637:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928230:0:22637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711882.928236:0:22637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacbcb74200/0xcf3cf816241e0b5b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711882.928256:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bc8ed208-5edc-469a-a5f9-449dbe325e20:3607:1877696879775488:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1790711882.937580:0:23354:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1790711882.937624:0:23379:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1790711882.937630:0:23379:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790711882.944313:0:23380:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790711882.944317:0:23354:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1790711882.944902:0:23381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1877696879775616:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790711882.944996:0:23381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.945061:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879775616 00000100:00100000:2.0:1790711882.945071:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879775616 00000100:00100000:2.0:1790711882.945435:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790711882.945451:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1877696879775616:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790711882.945668:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1877696879775616:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 220us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711882.945678:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790711882.945727:0:23381:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb5259780 going to sleep for 11 seconds 00000100:00100000:2.0:1790711882.945760:0:23381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1877696879775616:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1790711882.945810:0:23381:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1790711882.945850:0:23381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1877696879775744:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790711882.946004:0:23381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.946035:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879775744 00000100:00100000:2.0:1790711882.946041:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879775744 00000040:01000000:3.0:1790711882.946442:0:23354:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1790711882.946491:0:23354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790711882.946728:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790711882.946739:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1877696879775744:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1790711882.946771:0:23380:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790711882.947863:0:23354:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790711882.947917:0:23354:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1790711882.948034:0:23354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790711882.948676:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1877696879775744:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1933us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711882.948703:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790711882.948764:0:23381:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb5259780 going to sleep for 11 seconds 00000100:00100000:2.0:1790711882.948802:0:23381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1877696879775744:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790711882.949319:0:23381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23381:1877696879775872:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790711882.949376:0:23381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.949418:0:23381:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb5259480 going to sleep for 11 seconds 00000100:00100000:1.0:1790711882.949595:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879775872 00000100:00100000:1.0:1790711882.949605:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879775872 00000100:00100000:1.0:1790711882.949665:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790711882.949677:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23381:x1877696879775872:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1790711882.949768:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23381:x1877696879775872:12345-0@lo:900:lod0001_rec0000.0 Request processed in 94us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711882.949792:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790711882.950463:0:23381:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dab8329c000 x1877696879775872/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790711898 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711882.950480:0:23381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23381:1877696879775872:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1790711882.951039:0:23381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1877696879776000:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790711882.951103:0:23381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711882.951167:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879776000 00000100:00100000:2.0:1790711882.951175:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879776000 00000100:00100000:2.0:1790711882.951236:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790711882.951245:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1877696879776000:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790711882.951340:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23381:x1877696879776000:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711882.951348:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790711882.951375:0:23381:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb5259780 going to sleep for 11 seconds 00000100:00100000:2.0:1790711882.951393:0:23381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23381:1877696879776000:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1790711882.951447:0:23381:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790711882.954979:0:23380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000040:00080000:3.0:1790711882.955045:0:23354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000004:00080000:0.0:1790711882.955087:0:23380:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1790711882.956342:0:23354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790711882.956407:0:23354:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1790711882.958035:0:23354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790711882.960449:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790711882.960591:0:23381:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790711882.960598:0:23381:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:3.0:1790711882.960971:0:23354:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1790711882.968073:0:23354:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1790711882.984665:0:23354:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790711882.984735:0:23354:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb22b41c4b988 00100000:10000000:3.0:1790711882.984746:0:23354:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1790711882.985510:0:23354:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790711882.985603:0:23354:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790711882.985630:0:23354:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790711882.985666:0:23354:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1790711882.994789:0:23354:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790711882.995149:0:23354:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1790711883.366073:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:1.0:1790711883.866882:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790711883.933042:0:23375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1790711884.061723:0:22619:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790711884.061734:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dacb5208000 from 12 10000000:01000000:1.0:1790711884.061742:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790711884.061815:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711884.061829:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711884.061843:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711884.061880:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879776128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790711884.061983:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711884.062040:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac86357900 going to sleep for 11 seconds 00000100:00100000:2.0:1790711884.062401:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879776128 00000100:00100000:2.0:1790711884.062412:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879776128 00000100:00100000:2.0:1790711884.062479:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790711884.062491:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+16:22619:x1877696879776128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790711884.062509:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711884.062529:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab82d15c00/0xcf3cf816241e0b69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0b62 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711884.062599:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab82d15c00/0xcf3cf816241e0b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0b62 expref: 17 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711884.062612:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab82d15c00/0xcf3cf816241e0b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b62 expref: 17 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711884.062641:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d15c00, rc 0) 00000100:00100000:2.0:1790711884.062833:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:22619:x1877696879776128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 344us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711884.062841:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790711884.063462:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879776128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790711884.063486:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711884.063498:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711884.065266:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879776256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790711884.065348:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711884.065401:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac86357900 going to sleep for 11 seconds 00000100:00100000:0.0:1790711884.065509:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879776256 00000100:00100000:0.0:1790711884.065519:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879776256 00000100:00100000:0.0:1790711884.065594:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790711884.065603:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:22619:x1877696879776256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790711884.065627:0:22613:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790711884.065647:0:22613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790711884.065651:0:22613:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1790711884.065759:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:22619:x1877696879776256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711884.065767:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790711884.066029:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879776256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790711884.066075:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790711884.066086:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711884.066097:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790711884.066108:0:22619:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790711884.066111:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dacae5ff800 from 12 10000000:01000000:1.0:1790711884.066115:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790711884.066142:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711884.066150:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711884.066160:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711884.066173:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879776384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790711884.066198:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711884.066227:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac86357900 going to sleep for 11 seconds 00000100:00100000:3.0:1790711884.066920:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879776384 00000100:00100000:3.0:1790711884.066931:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879776384 00000100:00100000:3.0:1790711884.066989:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790711884.066999:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:22619:x1877696879776384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790711884.067014:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711884.067033:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab82d13e00/0xcf3cf816241e0b77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0b70 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711884.067061:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab82d13e00/0xcf3cf816241e0b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0b70 expref: 18 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711884.067072:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab82d13e00/0xcf3cf816241e0b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b70 expref: 18 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711884.067082:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d13e00, rc 0) 00000100:00100000:3.0:1790711884.067140:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:22619:x1877696879776384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711884.067160:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790711884.068642:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879776384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790711884.068697:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711884.068712:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711884.069034:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879776512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790711884.069122:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711884.069177:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac98aa4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790711884.072088:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879776512 00000100:00100000:3.0:1790711884.072149:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879776512 00000100:00100000:3.0:1790711884.072226:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790711884.072238:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:22619:x1877696879776512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790711884.072280:0:22614:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790711884.072311:0:22614:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790711884.072314:0:22614:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1790711884.072708:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:22619:x1877696879776512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 471us (3584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711884.072717:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790711884.072879:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879776512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790711884.072953:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790711884.072965:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711884.072979:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711884.381854:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:1.0:1790711884.893180:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790711884.956393:0:23375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790711885.411102:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:1.0:1790711885.916561:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711886.428165:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:1.0:1790711886.941996:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711887.453091:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 0 seconds 00010000:00010000:1.0:1790711887.967157:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790711888.218845:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790711888.218852:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790711888.218856:0:8:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790711888.218865:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:3.0:1790711888.218870:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790711888.218882:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9daca0a46800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711888.218907:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e4700 x1877696879776768/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790711888.218926:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711888.218930:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711888.218933:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711888.218936:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711888.218977:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711888.218980:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711888.218983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711888.218986:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790711888.219022:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bc8ed208-5edc-469a-a5f9-449dbe325e20:3608:1877696879776640:0@lo:400:kworker.0 00000100:00100000:3.0:1790711888.219811:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711888.219883:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790711888.219894:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879777152:0@lo:400:kworker.0 00000100:00100000:3.0:1790711888.219929:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711888.219973:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879776768:0@lo:38:kworker.0 00000100:00100000:3.0:1790711888.220003:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711888.220037:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1877696879776896:0@lo:400:kworker.0 00000100:00100000:3.0:1790711888.221464:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711888.221518:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790711888.221533:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879777024:0@lo:400:kworker.0 00000100:00100000:3.0:1790711888.221579:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711888.221634:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879776640 00000100:00100000:3.0:1790711888.221642:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879776640 00000100:00100000:3.0:1790711888.222237:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790711888.222247:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:3608:x1877696879776640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711888.222322:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:3608:x1877696879776640:12345-0@lo:400:kworker.0 Request processed in 76us (2515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711888.222330:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790711888.222375:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879777152 00000100:00100000:3.0:1790711888.222390:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879777152 00000100:00100000:3.0:1790711888.222417:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879776896 00000100:00100000:3.0:1790711888.222420:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879776896 00000100:00100000:3.0:1790711888.222432:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790711888.222438:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879777152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711888.222473:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879777152:12345-0@lo:400:kworker.0 Request processed in 35us (2542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711888.222479:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790711888.222491:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790711888.222497:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1877696879776896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711888.222529:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1877696879776896:12345-0@lo:400:kworker.0 Request processed in 33us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711888.222536:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790711888.222574:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879776768 00000100:00100000:3.0:1790711888.222578:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879776768 00000100:00100000:3.0:1790711888.222590:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879777024 00000100:00100000:3.0:1790711888.222592:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879777024 00000100:00100000:3.0:1790711888.222605:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790711888.222610:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3606:x1877696879776768:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1790711888.222634:0:22627:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:3.0:1790711888.223616:0:22627:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3cf816241e0b7e 00000004:00100000:3.0:1790711888.223637:0:22627:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790711888.223661:0:22627:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:3.0:1790711888.223786:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dab838e4e00 x1877696879777152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711888.223802:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879777152:0@lo:400:kworker.0 00000100:00100000:3.0:1790711888.223815:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bc8ed208-5edc-469a-a5f9-449dbe325e20:3608:1877696879776640:0@lo:400:kworker.0 00010000:00080000:3.0:1790711888.223876:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dab838e7b80 x1877696879776896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711888.223887:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1877696879776896:0@lo:400:kworker.0 00000100:00100000:3.0:1790711888.227884:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879777280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790711888.227958:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711888.228018:0:22626:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1790711888.228026:0:22626:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1790711888.230774:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879777280 00000100:00100000:3.0:1790711888.230788:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879777280 00000100:00100000:0.0:1790711888.231065:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790711888.231078:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1877696879777024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711888.231178:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3609:x1877696879777024:12345-0@lo:400:kworker.0 Request processed in 104us (9598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711888.231186:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790711888.231206:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790711888.231213:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879777280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790711888.231238:0:23610:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790711888.231280:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879777280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (3322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711888.231287:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790711888.231415:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879777024:0@lo:400:kworker.0 00000100:00100000:3.0:1790711888.231454:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879777280:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1790711888.239365:0:22627:0:(import.c:65:import_set_state_nolock()) ffff9dacbc46d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790711888.239628:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3606:x1877696879776768:12345-0@lo:38:kworker.0 Request processed in 17013us (19620us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711888.239640:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790711888.245125:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790711888.245143:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1790711888.245153:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790711888.245160:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790711888.245164:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1790711888.245196:0:3606:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006c72a264): req@ffff9dab838e7100 x1877696879769856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711888.245215:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879776768:0@lo:38:kworker.0 00000100:00100000:0.0:1790711888.246399:0:22663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711888.246441:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb466a300 going to sleep for 11 seconds 00000100:00100000:3.0:1790711888.246589:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879769856 00000100:00100000:3.0:1790711888.246599:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879769856 00000100:00100000:0.0:1790711888.246737:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790711888.246760:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22663:x1877696879769856:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790711888.246842:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22663:x1877696879769856:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 84us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711888.246850:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790711888.246884:0:22663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22663:1877696879769856:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1790711888.246918:0:22663:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790711888.246955:0:22663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22663:1877696879777408:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790711888.247492:0:22663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711888.247812:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879777536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790711888.248241:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacbc566780 going to sleep for 11 seconds 00000100:00100000:0.0:1790711888.248262:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879777408 00000100:00100000:0.0:1790711888.248269:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879777408 00000100:00100000:2.0:1790711888.248342:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711888.265374:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879777536 00000100:00100000:3.0:1790711888.265400:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879777536 00000100:00100000:3.0:1790711888.265474:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790711888.265486:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22663:x1877696879777408:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790711888.265717:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22663:x1877696879777408:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 234us (18227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711888.265724:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790711888.265748:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790711888.265756:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3609:x1877696879777536:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790711888.265777:0:22663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22663:1877696879777408:0@lo:1000:lod0000_rec0001.0 00000004:00000024:3.0:1790711888.265788:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790711888.265832:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3609:x1877696879777536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (17490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711888.265840:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790711888.265894:0:22663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22663:1877696879777664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790711888.270076:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879777536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790711888.270513:0:22663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711888.270537:0:22663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacbc566780 going to sleep for 11 seconds 00000100:00100000:3.0:1790711888.273492:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879777664 00000100:00100000:3.0:1790711888.273503:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879777664 00000100:00100000:3.0:1790711888.273582:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790711888.273593:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22663:x1877696879777664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790711888.273727:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22663:x1877696879777664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 136us (3214us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711888.273735:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790711888.273778:0:22663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22663:1877696879777664:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1790711888.273849:0:22663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790711888.277241:0:22663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790711888.277333:0:22663:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:3.0:1790711888.277338:0:22663:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:0.0:1790711888.386358:0:23623:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790711888.990438:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790711889.435270:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1790711889.469919:0:23677:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790711889.471456:0:23677:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790711890.012032:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790711890.808930:0:23727:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790711890.809228:0:23727:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790711891.035507:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711892.059699:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790711892.283099:0:23775:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe944c4f20 20000000:00000080:1.0:1790711892.283119:0:23775:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dac9920dc00 uarg=0000000000000000 20000000:01000000:1.0:1790711892.283160:0:23775:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790711892.283168:0:23775:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790711892.283174:0:23775:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790711892.284044:0:23776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1790711892.284221:0:23775:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790711892.291975:0:23775:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790711892.292008:0:23775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711892.292028:0:23775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dacbcb74c00/0xcf3cf816241e0a2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0a27 expref: 17 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711892.292036:0:23775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0b31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b2a expref: 17 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711892.292044:0:23775:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711892.292091:0:23775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0b2a expref: 17 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711892.292132:0:23775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0b31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0b2a expref: 17 pid: 22613 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711892.292149:0:23775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23775:1877696879777792:0@lo:104: 00000100:00100000:1.0:1790711892.292217:0:23775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790711892.292400:0:23775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dacbcb74c00/0xcf3cf816241e0a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0a27 expref: 17 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711892.292408:0:23775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dacbcb74c00/0xcf3cf816241e0a2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0a27 expref: 17 pid: 22615 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711892.292415:0:23775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23775:1877696879777920:0@lo:104: 00000100:00100000:1.0:1790711892.292437:0:23775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711892.292888:0:23775:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb5259a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790711892.293326:0:22604:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879777792 00000100:00100000:2.0:1790711892.293402:0:22604:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879777792 00000100:00100000:2.0:1790711892.293509:0:22604:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879777920 00000100:00100000:2.0:1790711892.293514:0:22604:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879777920 00000100:00100000:2.0:1790711892.293531:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790711892.293568:0:22604:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+4:23775:x1877696879777792:12345-0@lo:104: 00010000:00010000:2.0:1790711892.293582:0:22604:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711892.293969:0:22604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790711892.293977:0:22604:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+4:23775:x1877696879777792:12345-0@lo:104: Request processed in 438us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711892.293985:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790711892.294006:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790711892.294014:0:22604:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:23775:x1877696879777920:12345-0@lo:104: 00010000:00010000:2.0:1790711892.294023:0:22604:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711892.294108:0:23775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23775:1877696879777792:0@lo:104: 00000100:00100000:1.0:1790711892.294119:0:23775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23775:1877696879777920:0@lo:104: 00010000:00010000:1.0:1790711892.294141:0:23775:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711892.295875:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790711892.295889:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711892.295899:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167de00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711892.295904:0:22609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711892.295938:0:22609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711892.295945:0:22609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711892.295952:0:22609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790711892.296006:0:22609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711892.296013:0:22609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790711892.296084:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879778048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790711892.296145:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790711892.297444:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711892.297459:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0b2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b31 expref: -99 pid: 23354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711892.297480:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711892.297483:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711892.297489:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d14400 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711892.297493:0:22609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711892.297502:0:22609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711892.297511:0:22609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711892.297537:0:22609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790711892.297594:0:22609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711892.297602:0:22609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711892.297627:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711892.297634:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dab82d14400/0xcf3cf816241e0a27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0a2e expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711892.297649:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711892.297651:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711892.297653:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711892.297735:0:22604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1790711892.297747:0:22604:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:23775:x1877696879777920:12345-0@lo:104: Request processed in 3730us (5304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711892.297758:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790711892.297872:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bc8ed208-5edc-469a-a5f9-449dbe325e20:3607:1877696879778176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790711892.297933:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711892.298041:0:22606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879778048 00000100:00100000:2.0:1790711892.298050:0:22606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879778048 00010000:00010000:2.0:1790711892.298081:0:22606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0b31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b2a expref: 18 pid: 22613 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711892.298113:0:22606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879778176 00000100:00100000:2.0:1790711892.298116:0:22606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879778176 00010000:00010000:2.0:1790711892.298129:0:22606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dacbcb74c00/0xcf3cf816241e0a2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0a27 expref: 19 pid: 22615 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711892.298165:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790711892.298174:0:22606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:3610:x1877696879778048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790711892.298187:0:22606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711892.298193:0:22606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0b31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b2a expref: 19 pid: 22613 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711892.298204:0:22606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0b2a expref: 19 pid: 22613 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711892.298220:0:22606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0b31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0b2a expref: 19 pid: 22613 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711892.298232:0:22606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790711892.298298:0:23376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790711892.298308:0:23376:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:3607:x1877696879778176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790711892.298317:0:23376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790711892.298322:0:23376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dacbcb74c00/0xcf3cf816241e0a2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0a27 expref: 18 pid: 22615 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298333:0:23376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dacbcb74c00/0xcf3cf816241e0a2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0a27 expref: 18 pid: 22615 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298364:0:23376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacbcb74c00/0xcf3cf816241e0a2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0a27 expref: 18 pid: 22615 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298375:0:23376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298383:0:23376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298402:0:23376:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298410:0:23376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298417:0:23376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298424:0:23376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298430:0:23376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb74a00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:3.0:1790711892.298435:0:23376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298443:0:23376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298460:0:23376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711892.298482:0:23376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790711892.298514:0:23376:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:3607:x1877696879778176:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711892.298521:0:23376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790711892.298590:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bc8ed208-5edc-469a-a5f9-449dbe325e20:3607:1877696879778176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790711892.298744:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711892.299205:0:22606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+16:3610:x1877696879778048:12345-0@lo:103:ldlm_bl.0 Request processed in 1030us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711892.299212:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1790711892.299756:0:23775:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711892.299767:0:23775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711892.299774:0:23775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0b85 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711892.301875:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879778048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790711892.314750:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711882/real 1790711882] req@ffff9dacb51b7b80 x1877696879773056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711892 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711892.314886:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dacb51b7b80 x1877696879773056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711892 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711892.314897:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711882/real 1790711882] req@ffff9dab8329fb80 x1877696879772928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711892 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711892.314907:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dab8329fb80 x1877696879772928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711892 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711892.314916:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711877/real 1790711877] req@ffff9dab838e4a80 x1877696879770880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711892 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711892.314926:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dab838e4a80 x1877696879770880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711892 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711892.314935:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711877/real 1790711877] req@ffff9dab838e5f80 x1877696879771008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711892 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711892.314945:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dab838e5f80 x1877696879771008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711892 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790711892.314962:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacb520d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790711892.314997:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790711892.315001:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879773056:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790711892.315008:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacb520e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790711892.315013:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790711892.315016:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879772928:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790711892.315019:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790711892.315023:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790711892.315026:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879770880:0@lo:8:kworker.0 00000100:00080000:3.0:1790711892.315030:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790711892.315033:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790711892.315036:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879771008:0@lo:8:kworker.0 00000100:00100000:1.0:1790711892.315326:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1790711892.315501:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790711892.315506:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790711892.315508:0:38:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790711892.315513:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 643 00000100:00080000:0.0:1790711892.315518:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790711892.315528:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9daca0a46000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711892.315577:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b5180 x1877696879778432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790711892.315593:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790711892.315596:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790711892.315598:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790711892.315601:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 643 00000100:00080000:0.0:1790711892.315627:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790711892.315634:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dab81c7d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711892.315650:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b5f80 x1877696879778560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790711892.315695:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790711892.315698:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790711892.315699:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dacb520e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790711892.315702:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1790711892.315704:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790711892.315709:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dacb520e800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711892.315717:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b4a80 x1877696879778944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790711892.315724:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790711892.315727:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790711892.315728:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dacb520d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790711892.315732:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1790711892.315734:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790711892.315738:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dacb520d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711892.315750:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b7b80 x1877696879779072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790711892.315820:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1877696879778688:0@lo:400:kworker.0 00000100:00100000:2.0:1790711892.315888:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711892.315922:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790711892.315936:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879778816:0@lo:400:kworker.0 00000100:00100000:2.0:1790711892.315964:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711892.316046:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879778688 00000100:00100000:3.0:1790711892.316054:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879778688 00000100:00100000:3.0:1790711892.316114:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790711892.316124:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1877696879778688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711892.316180:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1877696879778688:12345-0@lo:400:kworker.0 Request processed in 58us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711892.316187:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790711892.316225:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dacb51b4700 x1877696879778688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711892.316238:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1877696879778688:0@lo:400:kworker.0 00000100:00100000:3.0:1790711892.316259:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879778432:0@lo:8:kworker.0 00000400:00000100:3.0:1790711892.316281:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696879778432 offset 0 length 520: 4 00000100:00100000:3.0:1790711892.316303:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879778560:0@lo:8:kworker.0 00000400:00000100:3.0:1790711892.316330:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696879778560 offset 0 length 520: 4 00000100:00100000:3.0:1790711892.316356:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879778944:0@lo:8:kworker.0 00000400:00000100:3.0:1790711892.316374:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696879778944 offset 0 length 520: 4 00000100:00100000:3.0:1790711892.316385:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879779072:0@lo:8:kworker.0 00000400:00000100:3.0:1790711892.316400:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877696879779072 offset 0 length 520: 4 00000100:00100000:1.0:1790711892.316949:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877696879779200:0@lo:400:kworker.0 00000100:00100000:1.0:1790711892.316989:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711892.317056:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879778304:0@lo:400:kworker.0 00000100:00100000:1.0:1790711892.317093:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711892.317138:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879778816 00000100:00100000:1.0:1790711892.317143:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879778816 00000100:00100000:1.0:1790711892.317178:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879778304 00000100:00100000:1.0:1790711892.317183:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879778304 00000100:00100000:1.0:1790711892.317199:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790711892.317206:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879778816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711892.317250:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879778816:12345-0@lo:400:kworker.0 Request processed in 44us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711892.317256:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790711892.317271:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790711892.317277:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3607:x1877696879778304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711892.317311:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3607:x1877696879778304:12345-0@lo:400:kworker.0 Request processed in 34us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711892.317317:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790711892.317455:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879778304:0@lo:400:kworker.0 00000100:00100000:3.0:1790711892.317937:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879779200 00000100:00100000:3.0:1790711892.317944:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879779200 00000100:00100000:3.0:1790711892.318018:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790711892.318026:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877696879779200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711892.318083:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877696879779200:12345-0@lo:400:kworker.0 Request processed in 57us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711892.318090:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790711892.318154:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dacb51b7800 x1877696879779200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711892.318168:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877696879779200:0@lo:400:kworker.0 00000100:00100000:3.0:1790711892.318267:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879778816:0@lo:400:kworker.0 00010000:00010000:1.0:1790711893.090217:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711893.338757:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879779328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790711893.338829:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711893.338945:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879779328 00000100:00100000:2.0:1790711893.338954:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879779328 00000100:00100000:2.0:1790711893.339012:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790711893.339022:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3608:x1877696879779328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790711893.339057:0:23610:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790711893.339123:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3608:x1877696879779328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711893.339130:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790711893.339224:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879779328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790711893.344505:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790711893.344526:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879779456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790711893.344682:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711893.345345:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879779456 00000100:00100000:0.0:1790711893.345373:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879779456 00000100:00100000:0.0:1790711893.345436:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790711893.345446:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879779456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790711893.345480:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790711893.345572:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879779456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711893.345580:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790711893.345648:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879779456:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1790711893.868746:0:23355:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1790711894.114973:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790711894.171515:0:23375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1790711894.234662:0:22619:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790711894.234674:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dacb5208000 from 13 10000000:01000000:3.0:1790711894.234682:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790711894.234749:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711894.234763:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711894.234777:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711894.234810:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879779584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790711894.234912:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711894.234975:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca014a240 going to sleep for 11 seconds 00000100:00100000:0.0:1790711894.235074:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879779584 00000100:00100000:0.0:1790711894.235083:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879779584 00000100:00100000:0.0:1790711894.235141:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790711894.235151:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+16:22619:x1877696879779584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790711894.235166:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711894.235182:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac8167ce00/0xcf3cf816241e0b93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0b8c expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711894.235210:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac8167ce00/0xcf3cf816241e0b93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0b8c expref: 17 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711894.235222:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac8167ce00/0xcf3cf816241e0b93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b8c expref: 17 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711894.235232:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac8167ce00, rc 0) 00000100:00100000:0.0:1790711894.235283:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:22619:x1877696879779584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711894.235290:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790711894.235431:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879779584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790711894.235447:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711894.235457:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711894.235532:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879779712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790711894.235591:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711894.235623:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb5259780 going to sleep for 11 seconds 00000100:00100000:3.0:1790711894.235677:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879779712 00000100:00100000:3.0:1790711894.235681:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879779712 00000100:00100000:3.0:1790711894.235710:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790711894.235717:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:22619:x1877696879779712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790711894.235870:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:22619:x1877696879779712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711894.235879:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790711894.236021:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879779712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790711894.236050:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879779840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790711894.236087:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711894.236112:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb5259780 going to sleep for 11 seconds 00000100:00100000:3.0:1790711894.236153:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879779840 00000100:00100000:3.0:1790711894.236157:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879779840 00000100:00100000:3.0:1790711894.236187:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790711894.236194:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:22619:x1877696879779840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790711894.236283:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:22619:x1877696879779840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711894.236290:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790711894.236362:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879779840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790711894.248381:0:23843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790711894.251140:0:22619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790711894.251181:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790711894.251195:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711894.251208:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711894.251222:0:22619:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790711894.251225:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dacae5ff800 from 13 10000000:01000000:2.0:1790711894.251228:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790711894.251275:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711894.251283:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711894.251296:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711894.251339:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879779968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790711894.251414:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711894.251475:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac90e4fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790711894.251739:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879779968 00000100:00100000:0.0:1790711894.251756:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879779968 00000100:00100000:0.0:1790711894.251835:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790711894.251847:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+17:22619:x1877696879779968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790711894.251869:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711894.251891:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac8167d400/0xcf3cf816241e0ba1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0b9a expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711894.251926:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac8167d400/0xcf3cf816241e0ba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0b9a expref: 18 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711894.251939:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac8167d400/0xcf3cf816241e0ba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b9a expref: 18 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711894.251948:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac8167d400, rc 0) 00000100:00100000:0.0:1790711894.252032:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:22619:x1877696879779968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711894.252040:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790711894.252149:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879779968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790711894.252171:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711894.252181:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711894.252274:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879780096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790711894.252320:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711894.252353:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac90e4fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790711894.252463:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879780096 00000100:00100000:1.0:1790711894.252468:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879780096 00000100:00100000:1.0:1790711894.252505:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790711894.252513:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:22619:x1877696879780096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790711894.252690:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:22619:x1877696879780096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711894.252698:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790711894.252814:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879780096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790711894.252846:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879780224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790711894.252892:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711894.252917:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac90e4fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790711894.252964:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879780224 00000100:00100000:1.0:1790711894.252968:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879780224 00000100:00100000:1.0:1790711894.252997:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790711894.253003:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:22619:x1877696879780224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790711894.253102:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:22619:x1877696879780224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711894.253109:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790711894.253208:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879780224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790711894.254177:0:23844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790711894.254791:0:22619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790711894.254830:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790711894.254844:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711894.254858:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711895.132875:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711896.159718:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711897.178890:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790711897.435083:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711897.435090:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711897.435093:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711897.435115:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711897.435135:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711897.435139:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711897.435141:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711897.435144:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790711897.435293:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879780480:0@lo:400:kworker.0 00000100:00100000:2.0:1790711897.435362:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711897.435419:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790711897.435426:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877696879780608:0@lo:400:kworker.0 00000100:00100000:2.0:1790711897.435453:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711897.435495:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879780608 00000100:00100000:2.0:1790711897.435502:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879780608 00000100:00100000:2.0:1790711897.435587:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790711897.435597:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877696879780608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711897.435660:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877696879780608:12345-0@lo:400:kworker.0 Request processed in 64us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711897.435667:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790711897.435708:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dab838e4e00 x1877696879780608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711897.435723:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877696879780608:0@lo:400:kworker.0 00000100:00100000:1.0:1790711897.435999:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879780736:0@lo:400:kworker.0 00000100:00100000:1.0:1790711897.436033:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711897.436068:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790711897.436075:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879780352:0@lo:400:kworker.0 00000100:00100000:1.0:1790711897.436102:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711897.436123:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1877696879780864:0@lo:400:kworker.0 00000100:00100000:1.0:1790711897.436142:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711897.436299:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879780480 00000100:00100000:3.0:1790711897.436304:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879780480 00000100:00100000:3.0:1790711897.436343:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879780736 00000100:00100000:3.0:1790711897.436346:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879780736 00000100:00100000:3.0:1790711897.436362:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790711897.436369:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879780480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711897.436413:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879780480:12345-0@lo:400:kworker.0 Request processed in 44us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711897.436419:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790711897.436433:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790711897.436439:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879780736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711897.436475:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879780736:12345-0@lo:400:kworker.0 Request processed in 37us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711897.436480:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790711897.436497:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879780864 00000100:00100000:3.0:1790711897.436500:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879780864 00000100:00100000:3.0:1790711897.436518:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790711897.436524:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1877696879780864:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1790711897.436773:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dab838e5880 x1877696879780864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711897.436786:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1877696879780864:0@lo:400:kworker.0 00000100:00100000:0.0:1790711897.436795:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879780736:0@lo:400:kworker.0 00000100:00100000:2.0:1790711897.436868:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879780352 00000100:00100000:2.0:1790711897.436873:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879780352 00000100:00100000:2.0:1790711897.436905:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790711897.436912:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:3609:x1877696879780352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711897.436950:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:3609:x1877696879780352:12345-0@lo:400:kworker.0 Request processed in 38us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711897.436956:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790711897.437001:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879780352:0@lo:400:kworker.0 00000100:00100000:2.0:1790711897.437023:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879780480:0@lo:400:kworker.0 00000100:00100000:3.0:1790711897.437190:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1877696879780864:12345-0@lo:400:kworker.0 Request processed in 50us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711897.437216:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1790711898.210931:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711898.458867:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790711898.458889:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879780992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790711898.458957:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711898.459864:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879781120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790711898.459905:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711898.459943:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879780992 00000100:00100000:2.0:1790711898.459950:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879780992 00000100:00100000:2.0:1790711898.459988:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879781120 00000100:00100000:2.0:1790711898.459991:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879781120 00000100:00100000:2.0:1790711898.460007:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790711898.460032:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879780992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790711898.460064:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790711898.460107:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879780992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711898.460115:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790711898.460131:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790711898.460137:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879781120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790711898.460153:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790711898.460179:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879781120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711898.460184:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790711898.460218:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879781120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790711898.460230:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879780992:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790711899.227922:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790711899.675267:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1790711899.982344:0:24123:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790711899.982347:0:24123:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790711899.982349:0:24123:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790711899.982481:0:24123:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dacbfa34800 00000020:01000004:2.0:1790711899.982500:0:24123:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790711899.982515:0:24123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790711899.982585:0:24123:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9dacae9799c0) 00000020:00000080:2.0:1790711899.982605:0:24123:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790711900.074839:0:24123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790711900.079772:0:24123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790711900.080209:0:24123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790711900.080429:0:24123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790711900.080645:0:24123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790711900.080845:0:24123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790711900.081068:0:24123:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1790711900.082179:0:24123:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790711900.082390:0:24123:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790711900.082403:0:24123:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790711900.082414:0:24123:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf3cf816241e0baf 00000020:01000004:2.0:1790711900.082420:0:24123:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790711900.082439:0:24123:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790711900.082443:0:24123:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790711900.082449:0:24123:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790711900.082454:0:24123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790711900.082466:0:24123:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9dacae97cd40) 00000020:00000080:2.0:1790711900.082477:0:24123:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1790711900.085787:0:24123:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790711900.085972:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790711900.085978:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790711900.087902:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790711900.087912:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790711900.088203:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790711900.088210:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790711900.089846:0:24123:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790711900.090025:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790711900.090031:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790711900.091345:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790711900.091374:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790711900.120948:0:24123:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790711900.121212:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790711900.121219:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790711900.122736:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790711900.122747:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790711900.123443:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790711900.123451:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790711900.127332:0:24123:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790711900.127870:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790711900.127878:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790711900.128436:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790711900.128443:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1790711900.200214:0:24123:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790711900.200433:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1790711900.200439:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1790711900.202265:0:24123:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1790711900.202281:0:24123:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790711900.203292:0:24123:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790711900.203327:0:24123:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1790711900.203335:0:24123:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1790711900.222810:0:24123:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790711900.222856:0:24123:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.106@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1790711900.222861:0:24123:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790711900.222862:0:24123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790711900.222864:0:24123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790711900.222865:0:24123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790711900.222867:0:24123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790711900.222868:0:24123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790711900.222870:0:24123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790711900.222872:0:24123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790711900.222873:0:24123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790711900.222882:0:24123:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1790711900.222885:0:24123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790711900.222886:0:24123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790711900.222887:0:24123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790711900.222888:0:24123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790711900.222889:0:24123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790711900.222890:0:24123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790711900.222890:0:24123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790711900.222891:0:24123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790711900.222892:0:24123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790711900.222927:0:24123:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790711900.222948:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790711900.223025:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711900.223138:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb46c7180 going to sleep for 11 seconds 00000100:00100000:0.0:1790711900.227456:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879781248 00000100:00100000:0.0:1790711900.227474:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879781248 00000100:00100000:0.0:1790711900.227736:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790711900.227748:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:24123:x1877696879781248:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790711900.227786:0:22613:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790711900.227790:0:22613:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790711900.227794:0:22613:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790711900.228366:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:24123:x1877696879781248:12345-0@lo:253:mount.lustre.0 Request processed in 608us (5327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.228375:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790711900.230154:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781248:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790711900.230175:0:24123:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790711900.230179:0:24123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790711900.230180:0:24123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790711900.230181:0:24123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790711900.230183:0:24123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790711900.230184:0:24123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790711900.230185:0:24123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790711900.230187:0:24123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790711900.230189:0:24123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790711900.230190:0:24123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790711900.230219:0:24123:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dacbfa34800 from lustre-OST0000 10000000:01000000:3.0:1790711900.230280:0:24123:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1790711900.230283:0:24123:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790711900.230291:0:24123:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9daca0a24d40 local copy 00010000:00010000:3.0:1790711900.230302:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711900.230432:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790711900.230494:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711900.239180:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb46c7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790711900.241351:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879781376 00000100:00100000:2.0:1790711900.242317:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879781376 00000100:00100000:0.0:1790711900.242748:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790711900.242760:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:24123:x1877696879781376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711900.242954:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:24123:x1877696879781376:12345-0@lo:501:mount.lustre.0 Request processed in 196us (12460us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790711900.242963:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790711900.243286:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781376:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790711900.243807:0:24123:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790711900.243846:0:24123:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790711900.243856:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.243867:0:24123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711900.243900:0:24123:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dacbfa34800 10000000:01000000:0.0:1790711900.243905:0:24123:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790711900.243912:0:24123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790711900.243914:0:24123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790711900.243919:0:24123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1790711900.243922:0:24123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790711900.243956:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0bbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.243982:0:24123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0bbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.243992:0:24123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0bbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711900.244011:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781504:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790711900.244058:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711900.244265:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac876fd300 going to sleep for 11 seconds 00000100:00100000:2.0:1790711900.244323:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879781504 00000100:00100000:2.0:1790711900.244330:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879781504 00000100:00100000:0.0:1790711900.244716:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790711900.244726:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+18:24123:x1877696879781504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790711900.244739:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711900.244752:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac8167da00/0xcf3cf816241e0bc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0bbd expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.244775:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac8167da00/0xcf3cf816241e0bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0bbd expref: 19 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.244786:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac8167da00/0xcf3cf816241e0bc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0bbd expref: 19 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.244793:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac8167da00, rc 0) 00000100:00100000:0.0:1790711900.244829:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:24123:x1877696879781504:12345-0@lo:101:mount.lustre.0 Request processed in 106us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.244835:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790711900.244917:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790711900.244932:0:24123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0bbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0bc4 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.244941:0:24123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0bbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0bc4 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790711900.246249:0:24123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1790711900.246940:0:24123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790711900.247297:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1790711900.247330:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1790711900.247345:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1790711900.247525:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1790711900.247654:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1790711900.247675:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1790711900.247690:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1790711900.247704:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1790711900.247717:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1790711900.247730:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1790711900.247744:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1790711900.247759:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1790711900.247778:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1790711900.247784:0:24123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1790711900.247872:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790711900.247935:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711900.248331:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca01f0480 going to sleep for 11 seconds 00000100:00100000:2.0:1790711900.248403:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879781632 00000100:00100000:2.0:1790711900.248411:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879781632 00000100:00100000:2.0:1790711900.248453:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790711900.248462:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:24123:x1877696879781632:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790711900.248646:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:24123:x1877696879781632:12345-0@lo:501:mount.lustre.0 Request processed in 184us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711900.248654:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790711900.248842:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790711900.248879:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790711900.248922:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711900.248947:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca01f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1790711900.248993:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879781760 00000100:00100000:0.0:1790711900.248998:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879781760 00000100:00100000:1.0:1790711900.249252:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790711900.249260:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:24123:x1877696879781760:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790711900.250056:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:24123:x1877696879781760:12345-0@lo:503:mount.lustre.0 Request processed in 794us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711900.250065:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790711900.250312:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781760:0@lo:503:mount.lustre.0 00010000:00010000:0.0:1790711900.251008:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790711900.251408:0:24123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790711900.251493:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790711900.251851:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711900.251900:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca01f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1790711900.251953:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879781888 00000100:00100000:0.0:1790711900.251962:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879781888 00000100:00100000:0.0:1790711900.252011:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790711900.252020:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:24123:x1877696879781888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790711900.252521:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:24123:x1877696879781888:12345-0@lo:502:mount.lustre.0 Request processed in 502us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.252530:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790711900.252675:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879781888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790711900.252880:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1790711900.252910:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1790711900.252925:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1790711900.252960:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1790711900.252976:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1790711900.252988:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1790711900.253002:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1790711900.253015:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1790711900.253028:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1790711900.253042:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1790711900.253056:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1790711900.253068:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1790711900.253259:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790711900.253306:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711900.253345:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca01f0480 going to sleep for 11 seconds 00000100:00100000:3.0:1790711900.253711:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879782016 00000100:00100000:3.0:1790711900.253718:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879782016 00000100:00100000:3.0:1790711900.253766:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790711900.253774:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:24123:x1877696879782016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790711900.253970:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:24123:x1877696879782016:12345-0@lo:502:mount.lustre.0 Request processed in 196us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711900.253978:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790711900.254052:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790711900.254180:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1790711900.254192:0:24123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1790711900.255029:0:24140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790711900.255037:0:24140:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1790711900.255044:0:24140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711900.255047:0:24140:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790711900.255053:0:24140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790711900.255070:0:24140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9dacb13199c0) 00000020:00000080:3.0:1790711900.255092:0:24140:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790711900.255177:0:24140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790711900.255263:0:24140:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dacbfa34800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790711900.255273:0:24140:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790711900.255280:0:24140:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf3cf816241e0bd2 00010000:00010000:3.0:1790711900.261366:0:24140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1790711900.262059:0:24140:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1790711900.263991:0:24140:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1790711900.265845:0:24140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790711900.265858:0:24140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790711900.265865:0:24140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711900.265868:0:24140:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790711900.265872:0:24140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790711900.265875:0:24140:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1790711900.265877:0:24140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790711900.265889:0:24140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790711900.265890:0:24140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790711900.265893:0:24140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711900.265895:0:24140:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790711900.265897:0:24140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790711900.265901:0:24140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711900.265902:0:24140:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790711900.265906:0:24140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790711900.265908:0:24140:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790711900.265910:0:24140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790711900.265913:0:24140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711900.265914:0:24140:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790711900.265917:0:24140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790711900.265919:0:24140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711900.265921:0:24140:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790711900.265924:0:24140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790711900.265951:0:24140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790711900.265955:0:24140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790711900.265956:0:24140:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790711900.265960:0:24140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1790711900.266688:0:24123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790711900.266727:0:24123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790711900.266747:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0bbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0bc4 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.266758:0:24123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dac8167de00/0xcf3cf816241e0bbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0bc4 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711900.266766:0:24123:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dacbfa34800 from 1 10000000:01000000:0.0:1790711900.266770:0:24123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790711900.266806:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.266814:0:24123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.266825:0:24123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711900.266847:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790711900.266923:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711900.266965:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879782144 00000100:00100000:0.0:1790711900.266973:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879782144 00000100:00100000:0.0:1790711900.267015:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790711900.267023:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:24123:x1877696879782144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790711900.267036:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711900.267048:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac8167d600/0xcf3cf816241e0be0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0bd9 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.267070:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac8167d600/0xcf3cf816241e0be0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0bd9 expref: 20 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.267081:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac8167d600/0xcf3cf816241e0be0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0bd9 expref: 20 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.267089:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac8167d600, rc 0) 00000100:00100000:1.0:1790711900.267643:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca09313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790711900.267816:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:24123:x1877696879782144:12345-0@lo:101:mount.lustre.0 Request processed in 792us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.267824:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790711900.267957:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790711900.267975:0:24123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.267985:0:24123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790711900.269957:0:24123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1790711900.270342:0:24123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790711900.270525:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1790711900.270617:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1790711900.270635:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1790711900.270649:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1790711900.270664:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1790711900.270679:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1790711900.270693:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1790711900.270706:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1790711900.270721:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1790711900.270733:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1790711900.270748:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1790711900.270766:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1790711900.270772:0:24123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1790711900.270847:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790711900.270915:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711900.270960:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca01f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790711900.271049:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879782272 00000100:00100000:2.0:1790711900.271056:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879782272 00000100:00100000:2.0:1790711900.271114:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790711900.271124:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:24123:x1877696879782272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790711900.271229:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:24123:x1877696879782272:12345-0@lo:501:mount.lustre.0 Request processed in 107us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711900.271237:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790711900.271514:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790711900.271636:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790711900.271682:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711900.271707:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca01f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790711900.271794:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879782400 00000100:00100000:2.0:1790711900.271800:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879782400 00000100:00100000:2.0:1790711900.271868:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790711900.271877:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:24123:x1877696879782400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790711900.271967:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:24123:x1877696879782400:12345-0@lo:503:mount.lustre.0 Request processed in 92us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711900.271974:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790711900.275775:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790711900.276208:0:24123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790711900.276306:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790711900.276371:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711900.277524:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb44c7600 going to sleep for 11 seconds 00000100:00100000:3.0:1790711900.277719:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879782528 00000100:00100000:3.0:1790711900.277727:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879782528 00000100:00100000:1.0:1790711900.277830:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790711900.277839:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:24123:x1877696879782528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790711900.277994:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:24123:x1877696879782528:12345-0@lo:502:mount.lustre.0 Request processed in 155us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711900.278003:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790711900.278092:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790711900.278314:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1790711900.278341:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1790711900.278353:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1790711900.278367:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1790711900.278382:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1790711900.278397:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1790711900.278410:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1790711900.278422:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1790711900.278445:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1790711900.278460:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1790711900.278473:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1790711900.278512:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790711900.278674:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711900.278703:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac85130f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790711900.278770:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879782656 00000100:00100000:1.0:1790711900.278775:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879782656 00000100:00100000:1.0:1790711900.278800:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790711900.278807:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:24123:x1877696879782656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790711900.278893:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:24123:x1877696879782656:12345-0@lo:502:mount.lustre.0 Request processed in 86us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711900.278900:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790711900.278974:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790711900.279016:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1790711900.279026:0:24123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790711900.279793:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790711900.279803:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711900.279805:0:24144:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790711900.279811:0:24144:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dacbfa34800 00000020:00000080:2.0:1790711900.279814:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790711900.279822:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790711900.279824:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711900.279826:0:24144:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790711900.279828:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790711900.279831:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711900.279832:0:24144:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790711900.279836:0:24144:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dacbfa34800 00000020:00000080:2.0:1790711900.279838:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790711900.279889:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790711900.279892:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711900.279893:0:24144:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790711900.279902:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790711900.279905:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711900.279906:0:24144:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790711900.279909:0:24144:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dacbfa34800 00000020:00000080:2.0:1790711900.279911:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790711900.279929:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790711900.279932:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711900.279933:0:24144:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790711900.279935:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790711900.279938:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711900.279939:0:24144:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790711900.279943:0:24144:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dacbfa34800 00000020:00000080:2.0:1790711900.279944:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790711900.279963:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790711900.279966:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711900.279967:0:24144:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790711900.279970:0:24144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1790711900.280162:0:24123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790711900.280187:0:24123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790711900.280211:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711900.280221:0:24123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790711900.280272:0:24123:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790711900.280275:0:24123:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dacbfa34800 10000000:01000000:3.0:1790711900.280278:0:24123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dacbfa34800 10000000:01000000:3.0:1790711900.280283:0:24123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790711900.280288:0:24123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dacbfa34800 from 1 10000000:01000000:3.0:1790711900.280291:0:24123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790711900.280319:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d12800/0xcf3cf816241e0be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711900.280328:0:24123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d12800/0xcf3cf816241e0be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711900.280339:0:24123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d12800/0xcf3cf816241e0be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711900.280359:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790711900.280412:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711900.285620:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac851300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790711900.285815:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879782784 00000100:00100000:0.0:1790711900.285826:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879782784 00000100:00100000:1.0:1790711900.285960:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790711900.285974:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:24123:x1877696879782784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790711900.285991:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711900.286008:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacbcb75200/0xcf3cf816241e0bee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0be7 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.286037:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb75200/0xcf3cf816241e0bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0be7 expref: 21 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.286048:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacbcb75200/0xcf3cf816241e0bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0be7 expref: 21 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.286056:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacbcb75200, rc 0) 00000100:00100000:1.0:1790711900.286125:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879782784:12345-0@lo:101:mount.lustre.0 Request processed in 155us (5713us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711900.286133:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790711900.286268:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790711900.286284:0:24123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d12800/0xcf3cf816241e0be7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0bee expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711900.286293:0:24123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d12800/0xcf3cf816241e0be7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0bee expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790711900.287787:0:24123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1790711900.288065:0:24123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790711900.288232:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1790711900.288258:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1790711900.288272:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1790711900.288287:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1790711900.288301:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1790711900.288317:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1790711900.288332:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1790711900.288347:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1790711900.288381:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1790711900.288398:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1790711900.288412:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1790711900.288427:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1790711900.288440:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1790711900.288451:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1790711900.288464:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1790711900.288477:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1790711900.288492:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1790711900.288506:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1790711900.288519:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1790711900.288534:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1790711900.288701:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1790711900.288716:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1790711900.288728:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1790711900.288741:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1790711900.288768:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1790711900.288783:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1790711900.288794:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1790711900.288806:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1790711900.288818:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1790711900.288831:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1790711900.288843:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1790711900.288855:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1790711900.288868:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1790711900.288880:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1790711900.288893:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1790711900.288905:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1790711900.288918:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1790711900.288930:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1790711900.288943:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1790711900.288955:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1790711900.288982:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1790711900.288997:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1790711900.289009:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1790711900.289023:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1790711900.289038:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1790711900.289052:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1790711900.289066:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1790711900.289081:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1790711900.289210:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1790711900.289232:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1790711900.289251:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1790711900.289256:0:24123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1790711900.289354:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790711900.289426:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711900.292874:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac851303c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790711900.293064:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879782912 00000100:00100000:0.0:1790711900.293073:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879782912 00000100:00100000:0.0:1790711900.293113:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790711900.293121:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879782912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711900.293294:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879782912:12345-0@lo:501:mount.lustre.0 Request processed in 173us (3867us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.293302:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790711900.293406:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879782912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790711900.293456:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879783040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790711900.293504:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711900.293674:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac851303c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790711900.297484:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879783040 00000100:00100000:0.0:1790711900.297497:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879783040 00000100:00100000:0.0:1790711900.297647:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790711900.297654:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879783040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790711900.297809:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879783040:12345-0@lo:503:mount.lustre.0 Request processed in 154us (4303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.297816:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790711900.298695:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879783040:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790711900.299064:0:24123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790711900.299148:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879783168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790711900.299202:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711900.299235:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac851300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790711900.299834:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879783168 00000100:00100000:0.0:1790711900.299842:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879783168 00000100:00100000:0.0:1790711900.299877:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790711900.299884:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879783168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790711900.299993:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879783168:12345-0@lo:502:mount.lustre.0 Request processed in 108us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.300000:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790711900.300476:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879783168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790711900.304384:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1790711900.304445:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1790711900.304463:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1790711900.304478:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1790711900.304493:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1790711900.304505:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1790711900.304519:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1790711900.304534:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1790711900.304733:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1790711900.304750:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1790711900.304765:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1790711900.304779:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1790711900.304793:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1790711900.304808:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1790711900.304821:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1790711900.304850:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1790711900.304884:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1790711900.304903:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1790711900.304918:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1790711900.304931:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1790711900.304944:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1790711900.304956:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1790711900.304969:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1790711900.304985:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1790711900.304999:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1790711900.305014:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1790711900.305029:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1790711900.305042:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1790711900.305056:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1790711900.305069:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1790711900.305083:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1790711900.305096:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1790711900.305123:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1790711900.305140:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1790711900.305154:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1790711900.305168:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1790711900.305181:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1790711900.305194:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1790711900.305208:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1790711900.305222:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1790711900.305234:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1790711900.305246:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1790711900.305260:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1790711900.305274:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1790711900.305289:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1790711900.305299:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1790711900.305312:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1790711900.305324:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1790711900.305399:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879783296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790711900.305478:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711900.305521:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac851300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790711900.305682:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879783296 00000100:00100000:0.0:1790711900.305690:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879783296 00000100:00100000:0.0:1790711900.305740:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790711900.305748:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879783296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790711900.305872:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879783296:12345-0@lo:502:mount.lustre.0 Request processed in 124us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.305880:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790711900.308728:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879783296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790711900.308978:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1790711900.309009:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1790711900.309048:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879783424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790711900.309119:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711900.309167:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac851300c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790711900.309261:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879783424 00000100:00100000:2.0:1790711900.309270:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879783424 00000100:00100000:2.0:1790711900.309326:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790711900.309336:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879783424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790711900.309478:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879783424:12345-0@lo:502:mount.lustre.0 Request processed in 143us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711900.309487:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790711900.309927:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879783424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790711900.309974:0:24123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1790711900.309983:0:24123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790711900.312832:0:24149:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790711900.312852:0:24149:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9dab8339cd40) 00000020:00000080:3.0:1790711900.312877:0:24149:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1790711900.312956:0:24149:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dacbfa34800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790711900.312961:0:24149:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dacbfa34800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790711900.312964:0:24149:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dacbfa34800 3 00010000:00080000:3.0:1790711900.312992:0:24149:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dac8fd8f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1790711900.318996:0:24149:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1790711900.319235:0:24149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790711900.319277:0:24149:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790711900.319288:0:24149:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcf3cf816241e0bfc 00000100:00080000:3.0:1790711900.319297:0:24149:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790711900.319307:0:24149:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9dac8fd8f000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711900.319341:0:24149:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e4a80 x1877696879783552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790711900.319400:0:24149:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790711900.319530:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711900.319534:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790711900.319537:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1790711900.319774:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1877696879783552:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790711900.319850:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711900.320075:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879783552 00000100:00100000:1.0:1790711900.320082:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879783552 00000100:00100000:1.0:1790711900.320113:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790711900.320120:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3606:x1877696879783552:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790711900.320143:0:22623:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 666 last 0 00000020:00000080:1.0:1790711900.320174:0:22623:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcf3cf816241e0c03 00000004:00100000:1.0:1790711900.320189:0:22623:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790711900.320216:0:22623:0:(import.c:65:import_set_state_nolock()) ffff9dac8fd6b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790711900.320265:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877696879783552:12345-0@lo:38:llog_process_th.0 Request processed in 144us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711900.320273:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790711900.320310:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dab838e4a80 x1877696879783552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790711910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711900.320320:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790711900.320326:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1790711900.320332:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790711900.320336:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790711900.320338:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dac8fd8f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790711900.320343:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3606:1877696879783552:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1790711900.320380:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790711900.320414:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711900.320424:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790711900.320426:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711900.320429:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790711900.320461:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879784064:0@lo:400:kworker.0 00000100:00100000:2.0:1790711900.320492:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711900.320515:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790711900.320520:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879783936:0@lo:400:kworker.0 00000100:00100000:2.0:1790711900.320727:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711900.320759:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879784064 00000100:00100000:2.0:1790711900.320763:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879784064 00000100:00100000:2.0:1790711900.320792:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790711900.320798:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879784064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711900.320837:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879784064:12345-0@lo:400:kworker.0 Request processed in 39us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711900.320843:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790711900.320877:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879783936 00000100:00100000:2.0:1790711900.320882:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879783936 00000100:00100000:2.0:1790711900.320908:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790711900.320915:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879783936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711900.320950:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879783936:12345-0@lo:400:kworker.0 Request processed in 36us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711900.320956:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790711900.320980:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879783936:0@lo:400:kworker.0 00010000:00080000:2.0:1790711900.320989:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dab8329fb80 x1877696879784064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711900.321010:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879784064:0@lo:400:kworker.0 00000100:00100000:0.0:1790711900.323013:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1877696879783808:0@lo:400:kworker.0 00000100:00100000:0.0:1790711900.323080:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711900.323121:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790711900.323128:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8329c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879783680:0@lo:400:kworker.0 00000100:00100000:0.0:1790711900.323153:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711900.323208:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879783808 00000100:00100000:0.0:1790711900.323216:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879783808 00000100:00100000:0.0:1790711900.323256:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790711900.323265:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1877696879783808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711900.323315:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1877696879783808:12345-0@lo:400:kworker.0 Request processed in 51us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.323322:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790711900.323346:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879783680 00000100:00100000:0.0:1790711900.323349:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879783680 00000100:00100000:0.0:1790711900.323371:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790711900.323378:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879783680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711900.323410:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879783680:12345-0@lo:400:kworker.0 Request processed in 33us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.323416:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790711900.323454:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879783680:0@lo:400:kworker.0 00010000:00080000:0.0:1790711900.323465:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dab8329df80 x1877696879783808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711900.323475:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8329df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1877696879783808:0@lo:400:kworker.0 00000020:01000004:3.0:1790711900.323911:0:24149:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790711900.323930:0:24149:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9dab833999c0) 00000020:00000080:3.0:1790711900.323952:0:24149:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1790711900.324026:0:24149:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dacbfa34800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790711900.324030:0:24149:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dacbfa34800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790711900.324032:0:24149:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dacbfa34800 3 00010000:00080000:3.0:1790711900.324059:0:24149:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dac8fd8e000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1790711900.334132:0:24149:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1790711900.334345:0:24149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1790711900.334391:0:24149:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790711900.334405:0:24149:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcf3cf816241e0c11 00000100:00080000:3.0:1790711900.334417:0:24149:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790711900.334430:0:24149:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9dac8fd8e000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711900.335675:0:24149:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e7800 x1877696879784192/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790711900.335706:0:24149:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790711900.337863:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3606:1877696879784192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790711900.337939:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1790711900.338228:0:24149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1790711900.338281:0:24123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790711900.338311:0:24123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790711900.338326:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d12800/0xcf3cf816241e0be7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0bee expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711900.338338:0:24123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d12800/0xcf3cf816241e0be7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0bee expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790711900.338380:0:24123:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790711900.338385:0:24123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790711900.338386:0:24123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790711900.338387:0:24123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790711900.338388:0:24123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790711900.338390:0:24123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790711900.338391:0:24123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790711900.338393:0:24123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790711900.338394:0:24123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790711900.338398:0:24123:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1790711900.338400:0:24123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790711900.338401:0:24123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790711900.338402:0:24123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790711900.338403:0:24123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790711900.338404:0:24123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790711900.338405:0:24123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790711900.338406:0:24123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790711900.338407:0:24123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790711900.338408:0:24123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790711900.338427:0:24123:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790711900.338438:0:24123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879784320:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790711900.338483:0:24123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711900.338499:0:24123:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac85130f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790711900.338904:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879784192 00000100:00100000:0.0:1790711900.338911:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879784192 00000100:00100000:0.0:1790711900.338942:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790711900.338949:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3606:x1877696879784192:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790711900.338973:0:22622:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 666 last 0 00000020:00000080:0.0:1790711900.339011:0:22622:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcf3cf816241e0c18 00000004:00100000:0.0:1790711900.339024:0:22622:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790711900.339055:0:22622:0:(import.c:65:import_set_state_nolock()) ffff9dab82e89000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790711900.339113:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877696879784192:12345-0@lo:38:llog_process_th.0 Request processed in 164us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.339120:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790711900.339142:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879784320 00000100:00100000:0.0:1790711900.339145:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879784320 00000100:00100000:0.0:1790711900.339172:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790711900.339179:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879784320:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790711900.339198:0:22614:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790711900.339211:0:22614:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1790711900.339335:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9dab838e7800 x1877696879784192/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790711910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711900.339345:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790711900.339351:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1790711900.339359:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790711900.339362:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790711900.339365:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dac8fd8e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790711900.339370:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3606:1877696879784192:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1790711900.339612:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711900.339617:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790711900.339620:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711900.339623:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790711900.339626:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711900.339629:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790711900.339631:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711900.339634:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:2.0:1790711900.349079:0:22614:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790711900.349094:0:22614:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1790711900.349269:0:22637:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790711900.349274:0:22637:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790711900.349369:0:22637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.349401:0:22637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dab82d15c00/0xcf3cf816241e0b69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b62 expref: 21 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.349410:0:22637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dab82d13e00/0xcf3cf816241e0b77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b70 expref: 21 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.349417:0:22637:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.349458:0:22637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dab82d13e00/0xcf3cf816241e0b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0b70 expref: 21 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.349472:0:22637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dab82d13e00/0xcf3cf816241e0b77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0b70 expref: 21 pid: 22614 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711900.349486:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24123:x1877696879784320:12345-0@lo:253:mount.lustre.0 Request processed in 10305us (10999us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711900.349487:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879784448:0@lo:104: 00000100:00100000:2.0:1790711900.349504:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790711900.349533:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790711900.349615:0:22637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dab82d15c00/0xcf3cf816241e0b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0b62 expref: 20 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711900.349850:0:24123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24123:1877696879784320:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790711900.349862:0:24123:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790711900.349865:0:24123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790711900.349866:0:24123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790711900.349867:0:24123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790711900.349868:0:24123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790711900.349869:0:24123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790711900.349870:0:24123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790711900.349872:0:24123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790711900.349873:0:24123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790711900.349875:0:24123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790711900.349887:0:24123:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1790711900.350701:0:22604:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879784448 00000100:00100000:0.0:1790711900.350709:0:22604:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879784448 00010000:00010000:1.0:1790711900.350720:0:22637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dab82d15c00/0xcf3cf816241e0b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0b62 expref: 20 pid: 22615 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711900.350736:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879784576:0@lo:104: 00000100:00100000:0.0:1790711900.350752:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790711900.350762:0:22604:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:22637:x1877696879784448:12345-0@lo:104: 00010000:00010000:0.0:1790711900.350776:0:22604:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711900.350786:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711900.350811:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac9b621d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790711900.350828:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879784448:0@lo:104: 00010000:00010000:0.0:1790711900.350831:0:22604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790711900.350839:0:22604:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:22637:x1877696879784448:12345-0@lo:104: Request processed in 79us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.350856:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790711900.350878:0:22604:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790711900.350887:0:22604:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879784576 00000100:00100000:0.0:1790711900.350891:0:22604:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879784576 00000100:00100000:0.0:1790711900.350909:0:22604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790711900.350915:0:22604:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dac98adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:22637:x1877696879784576:12345-0@lo:104: 00010000:00010000:0.0:1790711900.350923:0:22604:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.350962:0:22604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790711900.350967:0:22604:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dac98adbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:22637:x1877696879784576:12345-0@lo:104: Request processed in 53us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711900.350973:0:22604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1790711900.351009:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790711900.351015:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.351022:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb75e00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711900.351026:0:22609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.351035:0:22609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711900.351042:0:22609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711900.351049:0:22609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790711900.351222:0:22609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.351236:0:22609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711900.351256:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.351262:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75e00/0xcf3cf816241e0b70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b77 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.351273:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711900.351276:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.351282:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb75a00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711900.351285:0:22609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.351291:0:22609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711900.351297:0:22609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711900.351302:0:22609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790711900.351314:0:22609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.351320:0:22609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711900.351325:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.351330:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dacbcb75a00/0xcf3cf816241e0b62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b69 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711900.351348:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711900.351350:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711900.351351:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711900.351469:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711900.351483:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879784704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711900.351513:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711900.351593:0:22606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879784704 00000100:00100000:1.0:1790711900.351605:0:22606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879784704 00000100:00100000:0.0:1790711900.351690:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1790711900.351695:0:22606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dab82d13e00/0xcf3cf816241e0b77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b70 expref: 21 pid: 22614 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711900.351700:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879784832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711900.351733:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711900.352746:0:22606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879784832 00000100:00100000:1.0:1790711900.352754:0:22606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879784832 00010000:00010000:1.0:1790711900.352780:0:22606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dab82d15c00/0xcf3cf816241e0b69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b62 expref: 22 pid: 22615 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711900.353379:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790711900.353390:0:22606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:3609:x1877696879784704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790711900.353404:0:22606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790711900.353413:0:22606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dab82d13e00/0xcf3cf816241e0b77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b70 expref: 22 pid: 22614 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353426:0:22606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dab82d13e00/0xcf3cf816241e0b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0b70 expref: 22 pid: 22614 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353446:0:22606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d13e00/0xcf3cf816241e0b77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0b70 expref: 22 pid: 22614 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353463:0:22606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790711900.353525:0:22606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:3609:x1877696879784704:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711900.353533:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790711900.353598:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790711900.353605:0:22606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacafdca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:3609:x1877696879784832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790711900.353612:0:22606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790711900.353617:0:22606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dab82d15c00/0xcf3cf816241e0b69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b62 expref: 20 pid: 22615 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353709:0:22606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dab82d15c00/0xcf3cf816241e0b69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0b62 expref: 20 pid: 22615 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353722:0:22606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353729:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790711900.353745:0:22606:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004471606s 00010000:00010000:1.0:1790711900.353749:0:22606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353756:0:22606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353763:0:22606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353771:0:22606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353777:0:22606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb74a00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711900.353781:0:22606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353789:0:22606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353797:0:22606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.353816:0:22606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790711900.353842:0:22606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacafdca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:3609:x1877696879784832:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711900.353849:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790711900.354065:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879784832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790711900.354075:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879784704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790711900.354917:0:22637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d15c00/0xcf3cf816241e0b69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0b62 expref: 19 pid: 22615 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711900.354932:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879784576:0@lo:104: 00010000:00010000:1.0:1790711900.354951:0:22637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.354960:0:22637:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.354968:0:22637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711900.354974:0:22637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacbcb74a00/0xcf3cf816241e0c1f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1790711900.364466:0:24123:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1790711900.368929:0:24123:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790711900.368938:0:24123:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790711900.368998:0:24123:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790711900.369043:0:24123:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790711900.369064:0:24123:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790711900.369084:0:24123:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1790711900.373963:0:24123:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790711900.374258:0:24123:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790711901.275694:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790711901.494980:0:24204:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790711901.495216:0:24204:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1790711902.234732:0:22619:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790711902.234740:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dacb5208000 from 13 10000000:01000000:1.0:1790711902.234747:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790711902.234795:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711902.234822:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711902.234835:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711902.234861:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879784960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790711902.234927:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711902.234971:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacbc566840 going to sleep for 11 seconds 00000100:00100000:0.0:1790711902.235143:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879784960 00000100:00100000:0.0:1790711902.235152:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879784960 00000100:00100000:0.0:1790711902.235197:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790711902.235206:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+19:22619:x1877696879784960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790711902.235219:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711902.235234:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0c2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0c26 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711902.235256:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0c26 expref: 20 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711902.235266:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0c26 expref: 20 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711902.235274:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7000, rc 0) 00000100:00100000:0.0:1790711902.235316:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:22619:x1877696879784960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711902.235333:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790711902.236152:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879784960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790711902.236170:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711902.236180:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711902.236236:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879785088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790711902.236277:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711902.236314:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac876fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1790711902.237530:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879785088 00000100:00100000:1.0:1790711902.237858:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879785088 00000100:00100000:1.0:1790711902.237920:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790711902.237930:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:22619:x1877696879785088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790711902.237951:0:22614:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790711902.237977:0:22614:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790711902.237980:0:22614:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1790711902.238104:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:22619:x1877696879785088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711902.238112:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790711902.238199:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879785088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790711902.238272:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790711902.238281:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711902.238291:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711902.238303:0:22619:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790711902.238305:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dacae5ff800 from 13 10000000:01000000:0.0:1790711902.238308:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790711902.238336:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711902.238344:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711902.238365:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711902.238395:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879785216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790711902.238429:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711902.238465:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac876fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1790711902.239053:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879785216 00000100:00100000:1.0:1790711902.239059:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879785216 00000100:00100000:1.0:1790711902.239091:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790711902.239099:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:22619:x1877696879785216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790711902.239109:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711902.239121:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0c3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0c34 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711902.239153:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0c34 expref: 21 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711902.239163:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0c34 expref: 21 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711902.239170:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacbcb75400, rc 0) 00000100:00100000:1.0:1790711902.239213:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:22619:x1877696879785216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711902.239219:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790711902.240091:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879785216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790711902.240110:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711902.240121:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711902.240183:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879785344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790711902.240226:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711902.240259:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacbc5660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790711902.245401:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879785344 00000100:00100000:0.0:1790711902.245418:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879785344 00000100:00100000:0.0:1790711902.245496:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790711902.245507:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:22619:x1877696879785344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790711902.245534:0:22615:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790711902.245588:0:22615:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790711902.245593:0:22615:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1790711902.245921:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:22619:x1877696879785344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 415us (5692us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711902.245929:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790711902.245988:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879785344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790711902.246056:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790711902.246066:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711902.246078:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711902.298778:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711903.322744:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711903.578904:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790711903.578925:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879785472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790711903.578995:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711903.579040:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879785472 00000100:00100000:2.0:1790711903.579046:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879785472 00000100:00100000:2.0:1790711903.579082:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790711903.579090:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879785472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790711903.579121:0:22626:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790711903.579161:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879785472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711903.579178:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790711903.579217:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879785472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790711903.579320:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879785600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790711903.579344:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711903.579410:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879785600 00000100:00100000:3.0:1790711903.579414:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879785600 00000100:00100000:3.0:1790711903.579443:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790711903.579451:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879785600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790711903.579472:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790711903.579505:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879785600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711903.579511:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790711903.579700:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879785600:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790711904.346800:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790711904.413633:0:23375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790711905.372087:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790711905.633496:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790711905.633503:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790711905.633506:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790711905.633509:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790711905.633588:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790711905.633601:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790711905.633603:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790711905.633606:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790711905.633782:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879785856:0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.633854:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711905.633896:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879786368:0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.633920:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711905.633944:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790711905.633949:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879785728:0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.633975:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711905.633994:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1877696879786240:0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.634014:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711905.634039:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877696879785984:0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.634061:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711905.634075:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1877696879786496:0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.634091:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711905.634100:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790711905.634105:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879786112:0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.634121:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711905.634144:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879786368 00000100:00100000:1.0:1790711905.634151:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879786368 00000100:00100000:1.0:1790711905.634192:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879786240 00000100:00100000:1.0:1790711905.634194:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879786240 00000100:00100000:1.0:1790711905.634204:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879785984 00000100:00100000:1.0:1790711905.634207:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879785984 00000100:00100000:1.0:1790711905.634224:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879786496 00000100:00100000:1.0:1790711905.634227:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879786496 00000100:00100000:1.0:1790711905.634241:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790711905.634249:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1877696879786368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.634300:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1877696879786368:12345-0@lo:400:kworker.0 Request processed in 51us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711905.634307:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790711905.634324:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790711905.634330:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1877696879786240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.634357:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1877696879786240:12345-0@lo:400:kworker.0 Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711905.634362:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790711905.634373:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790711905.634378:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877696879785984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.634407:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877696879785984:12345-0@lo:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711905.634412:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790711905.634422:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790711905.634428:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877696879786496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.634452:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877696879786496:12345-0@lo:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711905.634457:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790711905.634473:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879785728 00000100:00100000:1.0:1790711905.634476:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879785728 00000100:00100000:1.0:1790711905.634498:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790711905.634504:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:3610:x1877696879785728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.634574:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:3610:x1877696879785728:12345-0@lo:400:kworker.0 Request processed in 70us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711905.634579:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1790711905.634619:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790711905.634623:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790711905.634662:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab81cce300 x1877696879785984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711905.634676:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877696879785984:0@lo:400:kworker.0 00010000:00080000:1.0:1790711905.634687:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab81ccdc00 x1877696879786496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711905.634695:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1877696879786496:0@lo:400:kworker.0 00000100:00100000:1.0:1790711905.634719:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879785728:0@lo:400:kworker.0 00010000:00080000:1.0:1790711905.634727:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab81ccfb80 x1877696879786240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711905.634736:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1877696879786240:0@lo:400:kworker.0 00010000:00080000:1.0:1790711905.634746:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab81ccc380 x1877696879786368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711905.634753:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879786368:0@lo:400:kworker.0 00000100:00100000:3.0:1790711905.636216:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879785856 00000100:00100000:3.0:1790711905.636225:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879785856 00000100:00100000:3.0:1790711905.636276:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879786112 00000100:00100000:3.0:1790711905.636279:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879786112 00000100:00100000:3.0:1790711905.636295:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790711905.636302:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879785856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711905.636386:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879785856:12345-0@lo:400:kworker.0 Request processed in 85us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711905.636393:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790711905.636408:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790711905.636413:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879786112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711905.636446:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879786112:12345-0@lo:400:kworker.0 Request processed in 33us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711905.636463:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790711905.636531:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879785856:0@lo:400:kworker.0 00000100:00100000:3.0:1790711905.636584:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879786112:0@lo:400:kworker.0 00010000:00010000:1.0:1790711906.397595:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711907.418907:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711907.485945:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711892/real 1790711892] req@ffff9dacb51b4a80 x1877696879778944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711907 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711907.485979:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dacb51b4a80 x1877696879778944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711907 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711907.485989:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711892/real 1790711892] req@ffff9dacb51b7b80 x1877696879779072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711907 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711907.486004:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dacb51b7b80 x1877696879779072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711907 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790711907.486023:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacb520e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790711907.486053:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790711907.486057:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879778944:0@lo:8:kworker.0 00000100:00080000:2.0:1790711907.486063:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacb520d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790711907.486069:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790711907.486072:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879779072:0@lo:8:kworker.0 00000100:00080000:3.0:1790711907.486623:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711907.486628:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711907.486631:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711907.486634:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790711907.486651:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711907.486654:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790711907.486657:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dacb520e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790711907.486663:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 658 00000100:00080000:3.0:1790711907.486669:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790711907.486680:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9dacb520e800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711907.487061:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e5880 x1877696879787136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790711907.487081:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711907.487084:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790711907.487085:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dacb520d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790711907.487088:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 658 00000100:00080000:3.0:1790711907.487091:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790711907.487098:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dacb520d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711907.487112:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e6680 x1877696879787264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790711907.487178:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879787008:0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.487235:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711907.487270:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790711907.487879:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bc8ed208-5edc-469a-a5f9-449dbe325e20:3607:1877696879786624:0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.487920:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711907.487951:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877696879787392:0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.487975:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711907.488009:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879786752:0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.488033:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711907.488051:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1877696879787520:0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.488077:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711907.488096:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790711907.488102:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1877696879786880:0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.488123:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711907.488137:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879787648:0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.488158:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711907.488161:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879787392 00000100:00100000:2.0:1790711907.488170:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879787392 00000100:00100000:3.0:1790711907.488174:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879787008 00000100:00100000:3.0:1790711907.488177:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879787008 00000100:00100000:2.0:1790711907.488213:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879787520 00000100:00100000:3.0:1790711907.488215:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879786752 00000100:00100000:2.0:1790711907.488215:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879787520 00000100:00100000:3.0:1790711907.488216:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879786752 00000100:00100000:3.0:1790711907.488232:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790711907.488236:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879786880 00000100:00100000:2.0:1790711907.488239:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879786880 00000100:00100000:3.0:1790711907.488241:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879787008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711907.488249:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879787648 00000100:00100000:2.0:1790711907.488250:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879787648 00000100:00100000:2.0:1790711907.488262:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790711907.488267:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877696879787392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.488300:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879787008:12345-0@lo:400:kworker.0 Request processed in 60us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711907.488307:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790711907.488333:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790711907.488339:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879786752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711907.488350:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879786624 00000100:00100000:0.0:1790711907.488355:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879786624 00000100:00100000:3.0:1790711907.488373:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879786752:12345-0@lo:400:kworker.0 Request processed in 35us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711907.488379:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790711907.488382:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790711907.488389:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:3607:x1877696879786624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.488394:0:22622:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790711907.488400:0:22622:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1790711907.488414:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790711907.488421:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790711907.488427:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1877696879787520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.488457:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1877696879787520:12345-0@lo:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711907.488463:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790711907.488476:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790711907.488481:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790711907.488486:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1877696879786880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.488526:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1877696879786880:12345-0@lo:400:kworker.0 Request processed in 39us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711907.488532:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790711907.488562:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790711907.488568:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790711907.488574:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1877696879787648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.488626:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1877696879787648:12345-0@lo:400:kworker.0 Request processed in 35us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711907.488634:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790711907.493299:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877696879787392:12345-0@lo:400:kworker.0 Request processed in 5020us (5311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711907.493316:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790711907.493380:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879787136:0@lo:8:kworker.0 00000100:00100000:2.0:1790711907.494588:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711907.494659:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879787264:0@lo:8:kworker.0 00000100:00100000:2.0:1790711907.494705:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790711907.494754:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790711907.494760:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790711907.494782:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879787136 00000100:00100000:2.0:1790711907.494790:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879787136 00000100:00100000:2.0:1790711907.494817:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879787264 00000100:00100000:2.0:1790711907.494820:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879787264 00000100:00100000:2.0:1790711907.494837:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790711907.494843:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1877696879787136:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790711907.494873:0:24129:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:2.0:1790711907.494902:0:24129:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3cf816241e0c42 00002000:00100000:2.0:1790711907.494916:0:24129:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9dab8209e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790711907.494920:0:24129:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1790711907.494922:0:24129:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1790711907.495220:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:3607:x1877696879786624:12345-0@lo:400:kworker.0 Request processed in 6829us (7296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711907.495231:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790711907.496470:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bc8ed208-5edc-469a-a5f9-449dbe325e20:3607:1877696879786624:0@lo:400:kworker.0 00010000:00080000:3.0:1790711907.496523:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab838e6d80 x1877696879787392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711907.496536:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877696879787392:0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.496564:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879787008:0@lo:400:kworker.0 00010000:00080000:3.0:1790711907.496628:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab838e4700 x1877696879786880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711907.496639:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1877696879786880:0@lo:400:kworker.0 00010000:00080000:3.0:1790711907.496653:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab838e4a80 x1877696879787648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711907.496662:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879787648:0@lo:400:kworker.0 00000100:00100000:3.0:1790711907.496675:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879786752:0@lo:400:kworker.0 00010000:00080000:3.0:1790711907.496699:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab838e7800 x1877696879787520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711907.496715:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1877696879787520:0@lo:400:kworker.0 00002000:00080000:2.0:1790711907.499245:0:24129:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1790711907.499289:0:24129:0:(import.c:65:import_set_state_nolock()) ffff9dab82099800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790711907.499393:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3606:x1877696879787136:12345-0@lo:8:kworker.0 Request processed in 4545us (4806us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711907.499404:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790711907.499438:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790711907.499444:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1877696879787264:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790711907.500172:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab838e5880 x1877696879787136/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790711927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:2.0:1790711907.500179:0:24129:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790711907.500184:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790711907.500192:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1790711907.500200:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790711907.500204:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790711907.500207:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacb520e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790711907.500225:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1877696879787264:12345-0@lo:8:kworker.0 Request processed in 779us (5519us total) trans 0 rc -19/-19 00000004:00080000:3.0:1790711907.500229:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790711907.500234:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790711907.500241:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879787136:0@lo:8:kworker.0 00000100:00080000:3.0:1790711907.500254:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacb520d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790711907.500259:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000004:00080000:2.0:1790711907.500261:0:23363:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1790711907.500262:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879787264:0@lo:8:kworker.0 00000004:00080000:3.0:1790711907.500325:0:23364:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1790711907.500346:0:23364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23364:1877696879787904:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1790711907.500355:0:23363:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 673584813932ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790711907.500361:0:23363:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1790711907.500380:0:23364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711907.500400:0:23364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb46c7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790711907.500414:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879787776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790711907.500436:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711907.500477:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879787904 00000100:00100000:3.0:1790711907.500483:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879787904 00000100:00100000:3.0:1790711907.500536:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790711907.500564:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23364:x1877696879787904:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1790711907.500565:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879787776 00000100:00100000:2.0:1790711907.500569:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879787776 00000100:00100000:2.0:1790711907.500590:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790711907.500596:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3607:x1877696879787776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790711907.500614:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790711907.500651:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3607:x1877696879787776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711907.500657:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1790711907.500718:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790711907.500783:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab81cc8700 x1877696879787776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790711923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711907.500799:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879787776:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1790711907.505476:0:23355:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1790711907.510124:0:24127:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1790711907.510155:0:24127:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1790711907.510268:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23364:x1877696879787904:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9700us (9881us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711907.510281:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790711907.510361:0:23364:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab81ccad80 x1877696879787904/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790711923 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711907.510377:0:23364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23364:1877696879787904:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1790711907.510391:0:23364:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1790711907.510430:0:23364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23364:1877696879788032:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1790711907.510478:0:23364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711907.510516:0:23364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac876fd900 going to sleep for 11 seconds 00000100:00100000:2.0:1790711907.514556:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879788032 00000100:00100000:2.0:1790711907.514572:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879788032 00000100:00100000:2.0:1790711907.514652:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790711907.514662:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23364:x1877696879788032:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1790711907.514703:0:24129:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1790711907.514801:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23364:x1877696879788032:12345-0@lo:5:osp-pre-0-1.0 Request processed in 140us (4323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711907.514808:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790711907.514919:0:23364:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dacb51b4700 x1877696879788032/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790711923 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711907.514934:0:23364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23364:1877696879788032:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1790711907.514950:0:23364:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1790711907.514994:0:23364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23364:1877696879788160:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1790711907.515041:0:23364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711907.515083:0:23364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac876fd900 going to sleep for 11 seconds 00000100:00100000:2.0:1790711907.516092:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879788160 00000100:00100000:2.0:1790711907.516102:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879788160 00000100:00100000:2.0:1790711907.516151:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790711907.516159:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23364:x1877696879788160:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1790711907.516196:0:24127:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:2.0:1790711907.555119:0:24124:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1790711907.555135:0:24124:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1790711907.555285:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23364:x1877696879788160:12345-0@lo:5:osp-pre-0-1.0 Request processed in 39123us (40240us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1790711907.555296:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790711907.555349:0:23364:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dacb51b4700 x1877696879788160/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790711923 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711907.555362:0:23364:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1790711907.555369:0:23364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23364:1877696879788160:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1790711907.555383:0:23364:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1790711907.555440:0:23364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5342300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23364:1877696879788288:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1790711907.555473:0:23364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711907.555495:0:23364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac83fab480 going to sleep for 11 seconds 00000100:00100000:2.0:1790711907.557897:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879788288 00000100:00100000:2.0:1790711907.557912:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879788288 00000100:00100000:2.0:1790711907.558641:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790711907.558656:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23364:x1877696879788288:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1790711907.558759:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23364:x1877696879788288:12345-0@lo:900:osp-pre-0-1.0 Request processed in 108us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711907.558767:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790711907.558822:0:23364:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dacb5342300 x1877696879788288/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790711923 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711907.558837:0:23364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5342300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23364:1877696879788288:0@lo:900:osp-pre-0-1.0 00000001:02000400:0.0:1790711907.942447:0:24496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790711908.444182:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711908.700531:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790711908.700571:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879788416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790711908.700657:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711908.700707:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879788416 00000100:00100000:0.0:1790711908.700714:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879788416 00000100:00100000:0.0:1790711908.700765:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790711908.700774:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879788416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790711908.700811:0:22626:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790711908.700859:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879788416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711908.700866:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790711908.700914:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879788416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790711908.701172:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790711908.701184:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879788544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790711908.701214:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711908.701259:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879788544 00000100:00100000:3.0:1790711908.701263:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879788544 00000100:00100000:3.0:1790711908.701289:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790711908.701295:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879788544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790711908.701314:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790711908.701350:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879788544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711908.701355:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790711908.701385:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879788544:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1790711908.890839:0:24548:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790711908.892752:0:24548:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790711909.466861:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790711909.859057:0:24598:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790711909.859269:0:24598:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1790711909.915170:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790711910.497997:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711911.515836:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711912.543095:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711912.602782:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711892/real 1790711892] req@ffff9dacb51b5180 x1877696879778432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711912 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711912.602815:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dacb51b5180 x1877696879778432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711912 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711912.602827:0:3606:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790711892/real 1790711892] req@ffff9dacb51b5f80 x1877696879778560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711912 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711912.602837:0:3606:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9dacb51b5f80 x1877696879778560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790711912 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790711912.602856:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790711912.602886:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790711912.602914:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879778432:0@lo:8:kworker.0 00000100:00080000:2.0:1790711912.602920:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790711912.602926:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790711912.602929:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879778560:0@lo:8:kworker.0 00000100:00080000:0.0:1790711912.603077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790711912.603081:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790711912.603084:0:8:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790711912.603089:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 658 00000100:00080000:0.0:1790711912.603094:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790711912.603103:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9daca0a46000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711912.603111:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790711912.603123:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879788800:0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.603179:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711912.603237:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879788800 00000100:00100000:0.0:1790711912.603250:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879788800 00000100:00100000:0.0:1790711912.603293:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790711912.603303:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879788800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.603356:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879788800:12345-0@lo:400:kworker.0 Request processed in 54us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711912.603364:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790711912.603402:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879788800:0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.603442:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b7480 x1877696879788928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790711912.603458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1790711912.603574:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790711912.603584:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879788672:0@lo:400:kworker.0 00000100:00100000:1.0:1790711912.603619:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711912.603652:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879788672 00000100:00100000:1.0:1790711912.603655:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879788672 00000100:00100000:1.0:1790711912.603682:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790711912.603688:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:3609:x1877696879788672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711912.603719:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:3609:x1877696879788672:12345-0@lo:400:kworker.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711912.603726:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790711912.603756:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879788672:0@lo:400:kworker.0 00000100:00080000:0.0:1790711912.603935:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790711912.603939:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790711912.603944:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 658 00000100:00080000:0.0:1790711912.603947:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790711912.603953:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dab81c7d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711912.603963:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879788928:0@lo:8:kworker.0 00000100:00100000:0.0:1790711912.603995:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711912.604033:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51b5f80 x1877696879789056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790711912.604080:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879789056:0@lo:8:kworker.0 00000100:00100000:3.0:1790711912.604107:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711912.604156:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879788928 00000100:00100000:0.0:1790711912.604160:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879788928 00000100:00100000:0.0:1790711912.604176:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879789056 00000100:00100000:0.0:1790711912.604179:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879789056 00000100:00100000:0.0:1790711912.604189:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790711912.604194:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1877696879788928:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790711912.604219:0:24129:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:0.0:1790711912.604254:0:24129:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3cf816241e0c49 00002000:00100000:0.0:1790711912.604267:0:24129:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9dab82e8f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790711912.604272:0:24129:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1790711912.604274:0:24129:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790711912.604346:0:24129:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790711912.604367:0:24129:0:(import.c:65:import_set_state_nolock()) ffff9dab82e88000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790711912.607858:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3606:x1877696879788928:12345-0@lo:8:kworker.0 Request processed in 3651us (3850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711912.607875:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790711912.607913:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790711912.607919:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1877696879789056:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790711912.607942:0:24129:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790711912.608010:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1877696879789056:12345-0@lo:8:kworker.0 Request processed in 90us (3902us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790711912.608017:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790711912.608117:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879789312:0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.608152:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711912.608189:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879789312 00000100:00100000:0.0:1790711912.608195:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879789312 00000100:00100000:0.0:1790711912.608227:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790711912.608232:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879789312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.608272:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879789312:12345-0@lo:400:kworker.0 Request processed in 40us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711912.608278:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790711912.608316:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879789312:0@lo:400:kworker.0 00000100:00080000:0.0:1790711912.608366:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790711912.608370:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790711912.608374:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dacb520d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790711912.608378:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 673 00000100:00080000:0.0:1790711912.608382:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790711912.608389:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dacb520d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:0.0:1790711912.608397:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879789440:0@lo:400:kworker.0 00000100:00100000:2.0:1790711912.608584:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790711912.608595:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877696879789184:0@lo:400:kworker.0 00000100:00100000:2.0:1790711912.608627:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711912.608657:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879789184 00000100:00100000:2.0:1790711912.608661:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879789184 00000100:00100000:2.0:1790711912.608688:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790711912.608694:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877696879789184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711912.608727:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877696879789184:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711912.608733:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1790711912.608760:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dacb51b5180 x1877696879789184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711912.608771:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877696879789184:0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.608927:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711912.608970:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb51d4380 x1877696879789568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790711912.609004:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790711912.609012:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879789696:0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.609035:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711912.609058:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879789696 00000100:00100000:0.0:1790711912.609062:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879789696 00000100:00100000:0.0:1790711912.609083:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790711912.609089:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879789696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.609121:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879789696:12345-0@lo:400:kworker.0 Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711912.609127:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1790711912.609148:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dacb51d7800 x1877696879789696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711912.609156:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879789696:0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.609182:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1877696879789824:0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.609219:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711912.609240:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879789824 00000100:00100000:0.0:1790711912.609243:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879789824 00000100:00100000:0.0:1790711912.609270:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790711912.609275:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1877696879789824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.609304:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1877696879789824:12345-0@lo:400:kworker.0 Request processed in 27us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711912.609310:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1790711912.609324:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790711912.609341:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dacb51d7800 x1877696879789824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711912.609349:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1877696879789824:0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.609380:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879789952:0@lo:400:kworker.0 00000100:00100000:0.0:1790711912.609401:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711912.609584:0:24130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879789440 00000100:00100000:1.0:1790711912.609589:0:24130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879789440 00000100:00100000:1.0:1790711912.609621:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790711912.609628:0:24130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879789440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711912.609662:0:24130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879789440:12345-0@lo:400:kworker.0 Request processed in 34us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711912.609667:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1790711912.609685:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790711912.609736:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879789952 00000100:00100000:2.0:1790711912.609740:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879789952 00000100:00100000:2.0:1790711912.609775:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790711912.609781:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1877696879789952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711912.609811:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1877696879789952:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711912.609816:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1790711912.609867:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790711912.610059:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dacb51d7800 x1877696879789952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711912.610070:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879789952:0@lo:400:kworker.0 00010000:00080000:0.0:1790711912.610097:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dacb51d4e00 x1877696879789440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790711928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711912.610105:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879789440:0@lo:400:kworker.0 00010000:00080000:3.0:1790711912.610403:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dacb51b7480 x1877696879788928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790711937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711912.610421:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790711912.610430:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1790711912.610750:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790711912.610758:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790711912.610762:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9daca0a46000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790711912.610780:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790711912.610788:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879788928:0@lo:8:kworker.0 00000100:00100000:3.0:1790711912.610808:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879789568:0@lo:8:kworker.0 00000100:00100000:3.0:1790711912.610857:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790711912.610894:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790711912.610900:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790711912.610903:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879789056:0@lo:8:kworker.0 00000100:00100000:1.0:1790711912.610950:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879789568 00000100:00100000:1.0:1790711912.610955:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879789568 00000100:00100000:1.0:1790711912.610984:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790711912.610989:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1877696879789568:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790711912.611009:0:24129:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790711912.611046:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1877696879789568:12345-0@lo:8:kworker.0 Request processed in 55us (189us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790711912.611064:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:2.0:1790711912.611176:0:22647:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1790711912.611202:0:22647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5341c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22647:1877696879790208:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790711912.611231:0:22647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711912.611245:0:22647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac851300c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790711912.611302:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879790208 00000100:00100000:1.0:1790711912.611306:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879790208 00000100:00100000:1.0:1790711912.611350:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790711912.611356:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22647:x1877696879790208:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790711912.611629:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879790080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790711912.611666:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711912.611913:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879790080 00000100:00100000:1.0:1790711912.611918:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879790080 00000100:00100000:1.0:1790711912.611987:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790711912.611993:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3610:x1877696879790080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790711912.612012:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790711912.612058:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3610:x1877696879790080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711912.612066:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790711912.612113:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dacb5341500 x1877696879790080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790711928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711912.612131:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879790080:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790711912.612679:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790711912.612948:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacb520d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790711912.612955:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790711912.612959:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879789568:0@lo:8:kworker.0 00000004:00080000:0.0:1790711912.613119:0:22646:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790711912.613194:0:22646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678697652970ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790711912.613200:0:22646:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1790711912.614271:0:22601:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1790711912.616017:0:24127:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1790711912.616033:0:24127:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1790711912.616042:0:24127:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00010000:2.0:1790711912.632014:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790711912.632028:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041f2838c/0xcf3cf816241e0c50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.632045:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=678s v=(0 0) 00010000:00010000:2.0:1790711912.632050:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790711912.632057:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041f2838c/0xcf3cf816241e0c50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.632074:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041f2838c/0xcf3cf816241e0c50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.632085:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041f2838c/0xcf3cf816241e0c50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.632094:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041f2838c/0xcf3cf816241e0c50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.632147:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790711912.632583:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790711912.632596:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dba2169c/0xcf3cf816241e0c57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.632605:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=678s v=(0 0) 00010000:00010000:2.0:1790711912.632608:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790711912.632612:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dba2169c/0xcf3cf816241e0c57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.632622:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dba2169c/0xcf3cf816241e0c57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.632630:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dba2169c/0xcf3cf816241e0c57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.632637:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dba2169c/0xcf3cf816241e0c57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.632761:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790711912.632771:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041f2838c/0xcf3cf816241e0c50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.632788:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d15600 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.632793:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041f2838c/0xcf3cf816241e0c50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.632802:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041f2838c/0xcf3cf816241e0c50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.632821:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041f2838c/0xcf3cf816241e0c50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.632829:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041f2838c/0xcf3cf816241e0c50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.632851:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711912.632855:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dba2169c/0xcf3cf816241e0c57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.632862:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d15400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.632949:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dba2169c/0xcf3cf816241e0c57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.632958:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dba2169c/0xcf3cf816241e0c57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.632970:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dba2169c/0xcf3cf816241e0c57 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.632985:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.632986:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.632989:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.633292:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790711912.633307:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dba2169c/0xcf3cf816241e0c57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790711912.633832:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790711912.633839:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009875e1b1/0xcf3cf816241e0c5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.633848:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=678s v=(0 0) 00010000:00010000:2.0:1790711912.633852:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790711912.633862:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009875e1b1/0xcf3cf816241e0c5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.633885:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009875e1b1/0xcf3cf816241e0c5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.633894:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009875e1b1/0xcf3cf816241e0c5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.633902:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009875e1b1/0xcf3cf816241e0c5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.634277:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711912.634285:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009875e1b1/0xcf3cf816241e0c5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.634293:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d14600 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.634775:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009875e1b1/0xcf3cf816241e0c5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.634786:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009875e1b1/0xcf3cf816241e0c5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.634802:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009875e1b1/0xcf3cf816241e0c5e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.634813:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.634815:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.634818:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.635016:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790711912.635023:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009875e1b1/0xcf3cf816241e0c5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790711912.636150:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790711912.636160:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a082605/0xcf3cf816241e0c65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.636172:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=678s v=(0 0) 00010000:00010000:2.0:1790711912.636176:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790711912.636181:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a082605/0xcf3cf816241e0c65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.636192:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a082605/0xcf3cf816241e0c65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.636213:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a082605/0xcf3cf816241e0c65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.636220:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a082605/0xcf3cf816241e0c65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.636280:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711912.636287:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a082605/0xcf3cf816241e0c65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.636295:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d14400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.636434:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a082605/0xcf3cf816241e0c65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.636450:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a082605/0xcf3cf816241e0c65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.636556:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a082605/0xcf3cf816241e0c65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.636567:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.636569:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.636571:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.636644:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790711912.636649:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a082605/0xcf3cf816241e0c65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790711912.637096:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790711912.637103:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a3a3c50/0xcf3cf816241e0c6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.637112:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=678s v=(0 0) 00010000:00010000:2.0:1790711912.637115:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790711912.637119:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a3a3c50/0xcf3cf816241e0c6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.637127:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a3a3c50/0xcf3cf816241e0c6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.637134:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a3a3c50/0xcf3cf816241e0c6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.637151:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a3a3c50/0xcf3cf816241e0c6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.637182:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711912.637188:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a3a3c50/0xcf3cf816241e0c6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.637194:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d15a00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.637197:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a3a3c50/0xcf3cf816241e0c6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.637205:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a3a3c50/0xcf3cf816241e0c6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.637215:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a3a3c50/0xcf3cf816241e0c6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.637222:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.637224:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.637225:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.637286:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790711912.637292:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a3a3c50/0xcf3cf816241e0c6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790711912.637728:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790711912.637734:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f08e433/0xcf3cf816241e0c73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.637743:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=678s v=(0 0) 00010000:00010000:2.0:1790711912.637745:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790711912.637749:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f08e433/0xcf3cf816241e0c73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.637758:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f08e433/0xcf3cf816241e0c73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.637766:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f08e433/0xcf3cf816241e0c73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.637773:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f08e433/0xcf3cf816241e0c73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.638172:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711912.638179:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f08e433/0xcf3cf816241e0c73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.638187:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d15800 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.638192:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f08e433/0xcf3cf816241e0c73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.638199:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f08e433/0xcf3cf816241e0c73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.638213:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f08e433/0xcf3cf816241e0c73 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.638222:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.638224:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.638226:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.638286:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790711912.638291:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f08e433/0xcf3cf816241e0c73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790711912.639239:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.639248:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a12256/0xcf3cf816241e0c7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.639260:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.639270:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.639275:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a12256/0xcf3cf816241e0c7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.639289:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017a12256/0xcf3cf816241e0c7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.639418:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a12256/0xcf3cf816241e0c7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.639426:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017a12256/0xcf3cf816241e0c7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.639499:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711912.639506:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017a12256/0xcf3cf816241e0c7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.639515:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d13200 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.639518:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a12256/0xcf3cf816241e0c7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.639527:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a12256/0xcf3cf816241e0c7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.639576:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017a12256/0xcf3cf816241e0c7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.639585:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.639587:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.639589:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711912.639753:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790711912.639758:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017a12256/0xcf3cf816241e0c7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790711912.640182:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.640188:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090457c0a/0xcf3cf816241e0c81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.640198:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.640201:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.640206:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090457c0a/0xcf3cf816241e0c81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.640217:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090457c0a/0xcf3cf816241e0c81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.640233:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090457c0a/0xcf3cf816241e0c81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.640241:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090457c0a/0xcf3cf816241e0c81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.640271:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711912.640277:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090457c0a/0xcf3cf816241e0c81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.640286:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d13e00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.640290:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090457c0a/0xcf3cf816241e0c81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.640300:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090457c0a/0xcf3cf816241e0c81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.640322:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090457c0a/0xcf3cf816241e0c81 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.640330:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.640332:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.640334:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711912.640727:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790711912.640733:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090457c0a/0xcf3cf816241e0c81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790711912.641165:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.641173:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b0debc0/0xcf3cf816241e0c88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.641183:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.641187:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.641191:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b0debc0/0xcf3cf816241e0c88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.641201:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b0debc0/0xcf3cf816241e0c88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.641210:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b0debc0/0xcf3cf816241e0c88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.641230:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b0debc0/0xcf3cf816241e0c88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.641304:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711912.641311:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b0debc0/0xcf3cf816241e0c88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.641329:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d12000 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.641333:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b0debc0/0xcf3cf816241e0c88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.641340:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b0debc0/0xcf3cf816241e0c88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.641363:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b0debc0/0xcf3cf816241e0c88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.641371:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.641372:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.641374:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711912.641829:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790711912.641837:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b0debc0/0xcf3cf816241e0c88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790711912.642269:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.642276:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e07afe1/0xcf3cf816241e0c8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.642286:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.642290:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.642295:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e07afe1/0xcf3cf816241e0c8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.643885:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e07afe1/0xcf3cf816241e0c8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.643899:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e07afe1/0xcf3cf816241e0c8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.643908:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e07afe1/0xcf3cf816241e0c8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.643958:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790711912.644960:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.644969:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abcefcde/0xcf3cf816241e0c96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.644982:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.644986:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.644992:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abcefcde/0xcf3cf816241e0c96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.645002:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abcefcde/0xcf3cf816241e0c96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.645011:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abcefcde/0xcf3cf816241e0c96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.645019:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abcefcde/0xcf3cf816241e0c96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.645031:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790711912.645857:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.645884:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e633b45a/0xcf3cf816241e0c9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.645895:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.645908:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.645913:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e633b45a/0xcf3cf816241e0c9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.645925:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e633b45a/0xcf3cf816241e0c9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.645935:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e633b45a/0xcf3cf816241e0c9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.645943:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e633b45a/0xcf3cf816241e0c9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.645953:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1790711912.646703:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.646712:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e1afb6/0xcf3cf816241e0ca4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.646723:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.646726:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.646731:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e1afb6/0xcf3cf816241e0ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.646742:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e1afb6/0xcf3cf816241e0ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.646751:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e1afb6/0xcf3cf816241e0ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.646767:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e1afb6/0xcf3cf816241e0ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.646777:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1790711912.647321:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.647329:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d20298b/0xcf3cf816241e0cab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.647338:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.647342:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.647347:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d20298b/0xcf3cf816241e0cab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.647442:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d20298b/0xcf3cf816241e0cab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.647452:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d20298b/0xcf3cf816241e0cab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.647460:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d20298b/0xcf3cf816241e0cab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.647729:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1790711912.648162:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.648168:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a509fb02/0xcf3cf816241e0cb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.648183:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.648186:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.648191:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a509fb02/0xcf3cf816241e0cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.648200:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a509fb02/0xcf3cf816241e0cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.648208:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a509fb02/0xcf3cf816241e0cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.648215:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a509fb02/0xcf3cf816241e0cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.648224:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1790711912.649022:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.649030:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b328a46/0xcf3cf816241e0cb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.649041:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.649045:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.649050:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b328a46/0xcf3cf816241e0cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.649060:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b328a46/0xcf3cf816241e0cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.649080:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b328a46/0xcf3cf816241e0cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.649088:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b328a46/0xcf3cf816241e0cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.649097:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1790711912.649608:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1790711912.649616:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e07afe1/0xcf3cf816241e0c8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649624:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d12400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711912.649629:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e07afe1/0xcf3cf816241e0c8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649651:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e07afe1/0xcf3cf816241e0c8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649670:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e07afe1/0xcf3cf816241e0c8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649677:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e07afe1/0xcf3cf816241e0c8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649699:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1790711912.649702:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abcefcde/0xcf3cf816241e0c96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649708:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d13400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711912.649711:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abcefcde/0xcf3cf816241e0c96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649718:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abcefcde/0xcf3cf816241e0c96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649727:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abcefcde/0xcf3cf816241e0c96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649735:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abcefcde/0xcf3cf816241e0c96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649760:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790711912.649764:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e633b45a/0xcf3cf816241e0c9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649770:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d13a00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711912.649773:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e633b45a/0xcf3cf816241e0c9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649780:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e633b45a/0xcf3cf816241e0c9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649790:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e633b45a/0xcf3cf816241e0c9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649797:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e633b45a/0xcf3cf816241e0c9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649809:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790711912.649812:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e1afb6/0xcf3cf816241e0ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649818:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d13800 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711912.649821:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e1afb6/0xcf3cf816241e0ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649841:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e1afb6/0xcf3cf816241e0ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649850:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e1afb6/0xcf3cf816241e0ca4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649857:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e1afb6/0xcf3cf816241e0ca4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649887:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790711912.649891:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d20298b/0xcf3cf816241e0cab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649897:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d13600 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711912.649900:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d20298b/0xcf3cf816241e0cab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649907:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d20298b/0xcf3cf816241e0cab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649917:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d20298b/0xcf3cf816241e0cab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649923:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d20298b/0xcf3cf816241e0cab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649944:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790711912.649948:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a509fb02/0xcf3cf816241e0cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649954:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d13c00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711912.649957:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a509fb02/0xcf3cf816241e0cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649964:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a509fb02/0xcf3cf816241e0cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649974:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a509fb02/0xcf3cf816241e0cb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649980:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a509fb02/0xcf3cf816241e0cb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.649991:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790711912.649994:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b328a46/0xcf3cf816241e0cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.650000:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d12600 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711912.650003:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b328a46/0xcf3cf816241e0cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.650020:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b328a46/0xcf3cf816241e0cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.650030:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b328a46/0xcf3cf816241e0cb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.650037:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b328a46/0xcf3cf816241e0cb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.650049:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711912.650051:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711912.650052:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.650802:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.650811:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33c26a7/0xcf3cf816241e0cc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.650822:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.650825:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.650830:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b33c26a7/0xcf3cf816241e0cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.650842:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b33c26a7/0xcf3cf816241e0cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.650851:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33c26a7/0xcf3cf816241e0cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.650858:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b33c26a7/0xcf3cf816241e0cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.651083:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790711912.651317:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711912.651324:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b33c26a7/0xcf3cf816241e0cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.651333:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184a00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.651336:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33c26a7/0xcf3cf816241e0cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.651355:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33c26a7/0xcf3cf816241e0cc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.651370:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b33c26a7/0xcf3cf816241e0cc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.651385:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b33c26a7/0xcf3cf816241e0cc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.651403:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.651405:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.651942:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.651949:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.651960:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.651964:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.651969:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.651978:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.651986:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.651993:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.652171:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790711912.652178:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.652186:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5185200 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711912.652189:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.652197:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.652224:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cc7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.652248:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711912.652249:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711912.652251:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.652731:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711912.652814:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790711912.652821:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790711912.653823:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.653831:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.653850:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.653854:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.653860:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.654001:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.654011:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.654020:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.654074:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790711912.654080:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.654089:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184600 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711912.654093:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.654102:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.654115:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711912.654123:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711912.654124:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711912.654126:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711912.654176:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790711912.654181:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790711912.654795:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.654802:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.654811:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.654815:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.654820:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.654840:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.654849:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.654856:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.655145:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711912.655152:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.655160:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184800 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.655164:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.655173:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.655186:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cd5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.655288:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790711912.655294:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790711912.656279:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.656287:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0cdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.656307:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.656311:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.656316:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0cdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.656326:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0cdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.658041:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0cdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.658055:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0cdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.658123:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711912.658130:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0cdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.658138:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711912.658141:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0cdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.658149:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0cdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.658166:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0cdc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.658175:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.658177:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711912.658248:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711912.668045:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790711912.668061:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0cdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.668570:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.672006:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.672020:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0ce3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.672037:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.672042:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.672048:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.672061:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.672071:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.672098:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.672121:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790711912.672135:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790711912.672140:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.672147:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5185400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:3.0:1790711912.672151:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.672159:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.672175:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0ce3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.672182:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0ce3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.672199:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711912.672200:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711912.672202:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.672476:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.674653:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.674683:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002047594a/0xcf3cf816241e0cea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.674697:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.674702:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.674709:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002047594a/0xcf3cf816241e0cea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.674723:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002047594a/0xcf3cf816241e0cea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.674734:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002047594a/0xcf3cf816241e0cea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.674742:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002047594a/0xcf3cf816241e0cea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.674771:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790711912.675096:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711912.675104:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002047594a/0xcf3cf816241e0cea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.675113:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184c00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711912.675124:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002047594a/0xcf3cf816241e0cea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.675134:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002047594a/0xcf3cf816241e0cea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.675151:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002047594a/0xcf3cf816241e0cea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.675157:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002047594a/0xcf3cf816241e0cea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.675176:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.675179:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.675180:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.676999:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.677010:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.677025:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.677029:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.677035:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.677046:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.677066:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.677073:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.677097:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790711912.677984:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711912.677994:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.678005:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184600 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711912.678009:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.678019:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.678038:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cf1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.678056:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb5409a0/0xcf3cf816241e0cf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.678078:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.678081:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.678083:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.678731:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.678740:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cf8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.678752:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.678756:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.678761:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.678773:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.678781:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.678789:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.678834:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790711912.679637:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711912.679646:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.679657:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5185200 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711912.679661:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.679671:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.679686:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cf8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.679694:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be176e5c/0xcf3cf816241e0cf8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.679712:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.679714:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.679716:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.681061:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.681072:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.681086:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.681090:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.681095:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.681107:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.681117:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.681124:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.681152:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790711912.681730:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711912.681739:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.681748:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184800 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711912.681753:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.681763:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.681780:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.681788:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b184c9a/0xcf3cf816241e0cff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.681809:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.681811:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.681813:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.682532:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.682565:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e0d06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.682579:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.682589:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.682595:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e0d06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.682607:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e0d06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.682617:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e0d06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.682625:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e0d06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.682646:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790711912.683279:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711912.683286:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e0d06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.683304:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184000 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711912.683308:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e0d06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.683336:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e0d06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.683424:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e0d06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.683433:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e0d06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.683962:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.683965:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.683968:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.684214:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.684222:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000929de65f/0xcf3cf816241e0d0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.684235:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.684239:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.684244:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000929de65f/0xcf3cf816241e0d0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.684256:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000929de65f/0xcf3cf816241e0d0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.684265:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000929de65f/0xcf3cf816241e0d0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.684280:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000929de65f/0xcf3cf816241e0d0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.684309:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790711912.685287:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711912.685307:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000929de65f/0xcf3cf816241e0d0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.685318:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184200 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711912.685323:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000929de65f/0xcf3cf816241e0d0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.685341:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000929de65f/0xcf3cf816241e0d0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.685432:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000929de65f/0xcf3cf816241e0d0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.685451:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000929de65f/0xcf3cf816241e0d0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.685486:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.685488:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.685490:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.686580:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.686590:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000701f0ce3/0xcf3cf816241e0d14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.686604:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.686609:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.686614:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000701f0ce3/0xcf3cf816241e0d14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.686625:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000701f0ce3/0xcf3cf816241e0d14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.686633:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000701f0ce3/0xcf3cf816241e0d14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.686640:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000701f0ce3/0xcf3cf816241e0d14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.686657:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790711912.687260:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711912.687268:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000701f0ce3/0xcf3cf816241e0d14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.687276:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5185000 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711912.687280:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000701f0ce3/0xcf3cf816241e0d14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.687288:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000701f0ce3/0xcf3cf816241e0d14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.687315:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000701f0ce3/0xcf3cf816241e0d14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.687323:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000701f0ce3/0xcf3cf816241e0d14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.687480:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.687484:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.687486:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.688142:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.688150:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0d1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.688166:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.688171:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.688176:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0d1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.688186:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0d1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.688195:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0d1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.688203:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0d1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.688226:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790711912.689016:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711912.689025:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0d1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.689034:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5185400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711912.689047:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0d1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.689056:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0d1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.689072:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0d1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.689079:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d0c24f8/0xcf3cf816241e0d1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711912.689095:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.689098:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711912.689099:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790711912.692125:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.692138:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0d22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.692154:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.692159:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.692165:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0d22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.692178:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0d22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.692200:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0d22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.692209:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0d22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.695148:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790711912.696918:0:24127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790711912.696930:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b010a1/0xcf3cf816241e0d29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.696948:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=678s v=(0 0) 00010000:00010000:3.0:1790711912.696952:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711912.696959:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b010a1/0xcf3cf816241e0d29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.696973:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b010a1/0xcf3cf816241e0d29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.696983:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b010a1/0xcf3cf816241e0d29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711912.696991:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050b010a1/0xcf3cf816241e0d29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.698594:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790711912.698607:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0d22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.698619:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711912.698624:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0d22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.698635:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0d22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.698654:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0d22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.698662:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb756a58/0xcf3cf816241e0d22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.698680:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711912.698684:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b010a1/0xcf3cf816241e0d29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.698690:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184e00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711912.698693:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b010a1/0xcf3cf816241e0d29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.698700:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b010a1/0xcf3cf816241e0d29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.698731:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b010a1/0xcf3cf816241e0d29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.698739:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.698741:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711912.698743:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711912.699721:0:24127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790711912.699731:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b010a1/0xcf3cf816241e0d29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711912.699823:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790711912.700069:0:24127:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1790711912.700161:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22647:x1877696879790208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 88801us (88926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711912.700170:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790711912.700374:0:22647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5341c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22647:1877696879790208:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790711912.700389:0:22647:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1790711912.700484:0:22647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5341c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22647:1877696879790336:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790711912.700524:0:22647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711912.700586:0:22647:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac9c00b240 going to sleep for 11 seconds 00000100:00100000:3.0:1790711912.700746:0:24130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879790336 00000100:00100000:3.0:1790711912.700753:0:24130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879790336 00000100:00100000:3.0:1790711912.700799:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790711912.700807:0:24130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22647:x1877696879790336:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790711912.700845:0:24130:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:0.0:1790711912.706144:0:24124:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1790711912.706188:0:24124:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1790711912.706752:0:24130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22647:x1877696879790336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5941us (6223us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1790711912.706763:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790711912.706846:0:22647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1790711912.706855:0:22647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5341c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22647:1877696879790336:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790711912.706870:0:22647:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:0.0:1790711912.794707:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790711912.794730:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5341180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879790464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790711912.794801:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711912.794851:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879790464 00000100:00100000:0.0:1790711912.794858:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879790464 00000100:00100000:0.0:1790711912.794915:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790711912.794925:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879790464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790711912.794948:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790711912.794992:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879790464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711912.795015:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790711912.795069:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5341180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879790464:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790711913.568559:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711913.819241:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879790592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790711913.819315:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711913.819429:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879790592 00000100:00100000:0.0:1790711913.819437:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879790592 00000100:00100000:0.0:1790711913.819505:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790711913.819516:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879790592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790711913.819580:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790711913.819635:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879790592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711913.819643:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790711913.819801:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879790592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790711913.820453:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790711913.820475:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879790720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790711913.820528:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711913.820716:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879790720 00000100:00100000:1.0:1790711913.820723:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879790720 00000100:00100000:1.0:1790711913.820765:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790711913.820792:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879790720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790711913.820821:0:23610:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790711913.820877:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879790720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711913.820894:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790711913.820989:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879790720:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790711914.594973:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790711914.656512:0:23375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790711915.611942:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711916.634833:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711917.658884:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790711917.673193:0:24945:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790711917.673198:0:24945:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1790711917.673200:0:24945:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1790711917.674007:0:24945:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9dab82e88800 00000020:01000004:0.0:1790711917.674025:0:24945:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790711917.674040:0:24945:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790711917.674054:0:24945:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9daca7308000) 00000020:00000080:0.0:1790711917.674070:0:24945:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790711917.788730:0:24945:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1790711917.795616:0:24945:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790711917.795842:0:24945:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790711917.796787:0:24945:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790711917.797093:0:24945:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1790711917.797523:0:24945:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790711917.797799:0:24945:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1790711917.801766:0:24945:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790711917.801998:0:24945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1790711917.802014:0:24945:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790711917.802025:0:24945:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf3cf816241e0d37 00000020:01000004:1.0:1790711917.802032:0:24945:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1790711917.802055:0:24945:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.106@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790711917.802059:0:24945:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790711917.802065:0:24945:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1790711917.802093:0:24945:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1790711917.802097:0:24945:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1790711917.820064:0:24945:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790711917.820108:0:24945:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.106@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1790711917.820113:0:24945:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790711917.820115:0:24945:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790711917.820116:0:24945:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790711917.820117:0:24945:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790711917.820119:0:24945:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790711917.820120:0:24945:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790711917.820121:0:24945:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790711917.820123:0:24945:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790711917.820124:0:24945:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790711917.820129:0:24945:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1790711917.820137:0:24945:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790711917.820138:0:24945:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790711917.820139:0:24945:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790711917.820140:0:24945:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790711917.820141:0:24945:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790711917.820142:0:24945:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790711917.820143:0:24945:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790711917.820144:0:24945:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790711917.820145:0:24945:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790711917.820174:0:24945:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790711917.820195:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879790848:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790711917.820264:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.820444:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb0e4e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790711917.822234:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879790848 00000100:00100000:1.0:1790711917.822249:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879790848 00000100:00100000:1.0:1790711917.822392:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790711917.822403:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24945:x1877696879790848:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790711917.822650:0:22614:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790711917.822655:0:22614:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1790711917.822664:0:22614:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790711917.823054:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24945:x1877696879790848:12345-0@lo:253:mount.lustre.0 Request processed in 652us (2788us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711917.823063:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790711917.823313:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879790848:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790711917.823327:0:24945:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790711917.823330:0:24945:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790711917.823332:0:24945:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790711917.823333:0:24945:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790711917.823334:0:24945:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790711917.823335:0:24945:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790711917.823337:0:24945:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790711917.823338:0:24945:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790711917.823340:0:24945:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790711917.823341:0:24945:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790711917.823502:0:24945:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9dab82e88800 from lustre-OST0001 10000000:01000000:0.0:1790711917.823562:0:24945:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790711917.823566:0:24945:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790711917.823574:0:24945:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9daca0a24d40 local copy 00010000:00010000:0.0:1790711917.823585:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711917.823712:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879790976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711917.823752:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.823789:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4762240 going to sleep for 11 seconds 00000100:00100000:2.0:1790711917.823847:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879790976 00000100:00100000:2.0:1790711917.823853:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879790976 00000100:00100000:2.0:1790711917.823976:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790711917.823984:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24945:x1877696879790976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790711917.824056:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24945:x1877696879790976:12345-0@lo:501:mount.lustre.0 Request processed in 74us (304us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790711917.824063:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790711917.824118:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879790976:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790711917.824131:0:24945:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790711917.824148:0:24945:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790711917.824154:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.824163:0:24945:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d14000/0xcf3cf816241e096a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0971 expref: -99 pid: 22600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711917.824190:0:24945:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9dab82e88800 10000000:01000000:0.0:1790711917.824195:0:24945:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790711917.824200:0:24945:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790711917.824203:0:24945:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790711917.824208:0:24945:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1790711917.824211:0:24945:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790711917.824234:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7800/0xcf3cf816241e0d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.824241:0:24945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7800/0xcf3cf816241e0d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.824250:0:24945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7800/0xcf3cf816241e0d3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711917.824263:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790711917.824285:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.824367:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4762240 going to sleep for 11 seconds 00000100:00100000:3.0:1790711917.824759:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879791104 00000100:00100000:3.0:1790711917.824765:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879791104 00000100:00100000:3.0:1790711917.824789:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790711917.824794:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:24945:x1877696879791104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790711917.824804:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711917.824823:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacb5184e00/0xcf3cf816241e0d45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0d3e expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711917.824842:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacb5184e00/0xcf3cf816241e0d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0d3e expref: 22 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711917.824852:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacb5184e00/0xcf3cf816241e0d45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0d3e expref: 22 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711917.824861:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacb5184e00, rc 0) 00000100:00100000:3.0:1790711917.825012:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:24945:x1877696879791104:12345-0@lo:101:mount.lustre.0 Request processed in 216us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711917.825019:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790711917.825080:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790711917.825094:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7800/0xcf3cf816241e0d3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0d45 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.825109:0:24945:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7800/0xcf3cf816241e0d3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0d45 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790711917.826295:0:24945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1790711917.827098:0:24945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790711917.829695:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1790711917.829750:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1790711917.829767:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1790711917.829781:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1790711917.829794:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1790711917.829807:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1790711917.829821:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1790711917.829835:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1790711917.829851:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1790711917.829874:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1790711917.829878:0:24945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1790711917.830033:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711917.830101:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.830178:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879791232 00000100:00100000:0.0:1790711917.830182:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac82be1900 going to sleep for 11 seconds 00000100:00100000:3.0:1790711917.830186:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879791232 00000100:00100000:3.0:1790711917.830279:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790711917.830289:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:24945:x1877696879791232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790711917.830470:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:24945:x1877696879791232:12345-0@lo:501:mount.lustre.0 Request processed in 183us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711917.830478:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790711917.830576:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711917.830610:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790711917.830656:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.831047:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac82be1900 going to sleep for 11 seconds 00000100:00100000:1.0:1790711917.831148:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879791360 00000100:00100000:1.0:1790711917.831154:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879791360 00000100:00100000:1.0:1790711917.831185:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790711917.831191:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:24945:x1877696879791360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790711917.832120:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:24945:x1877696879791360:12345-0@lo:503:mount.lustre.0 Request processed in 924us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711917.832130:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790711917.832253:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791360:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790711917.832805:0:24945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790711917.832891:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790711917.833162:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.833197:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4762240 going to sleep for 11 seconds 00000100:00100000:1.0:1790711917.833281:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879791488 00000100:00100000:1.0:1790711917.833288:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879791488 00000100:00100000:1.0:1790711917.833323:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790711917.833331:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:24945:x1877696879791488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790711917.834170:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:24945:x1877696879791488:12345-0@lo:502:mount.lustre.0 Request processed in 836us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711917.834180:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790711917.834312:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790711917.834800:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1790711917.834831:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1790711917.834847:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1790711917.834863:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1790711917.834882:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1790711917.834895:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1790711917.834909:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1790711917.834923:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1790711917.834936:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1790711917.834971:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790711917.835175:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.835216:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac82be1900 going to sleep for 11 seconds 00000100:00100000:1.0:1790711917.835257:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879791616 00000100:00100000:1.0:1790711917.835263:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879791616 00000100:00100000:1.0:1790711917.835298:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790711917.835303:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:24945:x1877696879791616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790711917.835823:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:24945:x1877696879791616:12345-0@lo:502:mount.lustre.0 Request processed in 518us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711917.835829:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790711917.835933:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790711917.835994:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1790711917.836013:0:24945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1790711917.837537:0:24949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790711917.837656:0:24949:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1790711917.837664:0:24949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790711917.837666:0:24949:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790711917.837673:0:24949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790711917.837690:0:24949:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9dacae978000) 00000020:00000080:2.0:1790711917.837715:0:24949:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790711917.837721:0:24949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790711917.837791:0:24949:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dab82e88800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790711917.837799:0:24949:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790711917.837819:0:24949:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf3cf816241e0d53 00010000:00010000:3.0:1790711917.842521:0:24949:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1790711917.843116:0:24949:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1790711917.849150:0:24949:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1790711917.854082:0:24949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790711917.854096:0:24949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711917.854102:0:24949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711917.854104:0:24949:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790711917.854108:0:24949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790711917.854112:0:24949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711917.854113:0:24949:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790711917.854116:0:24949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790711917.854118:0:24949:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790711917.854120:0:24949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711917.854123:0:24949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711917.854140:0:24949:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790711917.854144:0:24949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790711917.854147:0:24949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711917.854149:0:24949:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790711917.854152:0:24949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790711917.854182:0:24949:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790711917.854185:0:24949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790711917.854186:0:24949:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790711917.854189:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1790711917.854531:0:24945:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1790711917.854604:0:24945:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790711917.854628:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7800/0xcf3cf816241e0d3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0d45 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.854639:0:24945:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7800/0xcf3cf816241e0d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0d45 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790711917.854646:0:24945:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dab82e88800 from 1 10000000:01000000:1.0:1790711917.854649:0:24945:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790711917.854680:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.854688:0:24945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.854700:0:24945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711917.854723:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790711917.854785:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711917.854830:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac871be300 going to sleep for 11 seconds 00000100:00100000:2.0:1790711917.854927:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879791744 00000100:00100000:2.0:1790711917.854936:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879791744 00000100:00100000:2.0:1790711917.854994:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790711917.855180:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:24945:x1877696879791744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790711917.855194:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711917.855208:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab82d14400/0xcf3cf816241e0d61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0d5a expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711917.855231:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab82d14400/0xcf3cf816241e0d61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0d5a expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711917.855242:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab82d14400/0xcf3cf816241e0d61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0d5a expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711917.855263:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d14400, rc 0) 00000100:00100000:2.0:1790711917.855313:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:24945:x1877696879791744:12345-0@lo:101:mount.lustre.0 Request processed in 311us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.855319:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790711917.855965:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790711917.855993:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.856003:0:24945:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790711917.858104:0:24945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1790711917.860780:0:24945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790711917.861232:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1790711917.861266:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1790711917.861281:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1790711917.861293:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1790711917.861306:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1790711917.861319:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1790711917.861332:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1790711917.861346:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1790711917.861360:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1790711917.861373:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1790711917.861385:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1790711917.861403:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1790711917.861409:0:24945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1790711917.861520:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790711917.861615:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711917.861659:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac871beb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790711917.861956:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879791872 00000100:00100000:0.0:1790711917.861964:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879791872 00000100:00100000:0.0:1790711917.862212:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790711917.862222:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:24945:x1877696879791872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711917.862357:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:24945:x1877696879791872:12345-0@lo:501:mount.lustre.0 Request processed in 135us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711917.862364:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790711917.862453:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879791872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790711917.862490:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790711917.862530:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711917.862851:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac871beb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790711917.862890:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879792000 00000100:00100000:3.0:1790711917.862895:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879792000 00000100:00100000:3.0:1790711917.862923:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790711917.862930:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:24945:x1877696879792000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790711917.863228:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:24945:x1877696879792000:12345-0@lo:503:mount.lustre.0 Request processed in 297us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711917.863241:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790711917.863307:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792000:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790711917.864265:0:24945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790711917.864350:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790711917.864407:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711917.864457:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac871be300 going to sleep for 11 seconds 00000100:00100000:0.0:1790711917.864463:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879792128 00000100:00100000:0.0:1790711917.864469:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879792128 00000100:00100000:0.0:1790711917.864518:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790711917.864526:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:24945:x1877696879792128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790711917.865167:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:24945:x1877696879792128:12345-0@lo:502:mount.lustre.0 Request processed in 640us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711917.865176:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790711917.865206:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790711917.865414:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1790711917.865455:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1790711917.865471:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1790711917.865485:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1790711917.865498:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1790711917.865511:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1790711917.865522:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1790711917.865534:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1790711917.865571:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1790711917.865586:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1790711917.865600:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1790711917.865626:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790711917.865668:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.865701:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac876fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1790711917.865846:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879792256 00000100:00100000:1.0:1790711917.865851:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879792256 00000100:00100000:1.0:1790711917.865932:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790711917.865941:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:24945:x1877696879792256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790711917.866035:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:24945:x1877696879792256:12345-0@lo:502:mount.lustre.0 Request processed in 95us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711917.866042:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790711917.866388:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790711917.866461:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1790711917.866471:0:24945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1790711917.870905:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790711917.870919:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711917.870921:0:24953:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790711917.870929:0:24953:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dab82e88800 00000020:00000080:1.0:1790711917.870932:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790711917.870939:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790711917.870942:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711917.870943:0:24953:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790711917.870946:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790711917.870948:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711917.870949:0:24953:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790711917.870952:0:24953:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9dab82e88800 00000020:00000080:1.0:1790711917.870954:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790711917.871018:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790711917.871022:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711917.871024:0:24953:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790711917.871026:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790711917.871029:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711917.871030:0:24953:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790711917.871034:0:24953:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dab82e88800 00000020:00000080:1.0:1790711917.871608:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790711917.871637:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790711917.871640:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711917.871642:0:24953:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790711917.871645:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790711917.871648:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711917.871649:0:24953:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790711917.871653:0:24953:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9dab82e88800 00000020:00000080:1.0:1790711917.871656:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790711917.871709:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790711917.871713:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790711917.871715:0:24953:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790711917.871718:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1790711917.872164:0:24945:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790711917.872191:0:24945:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790711917.872213:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711917.872226:0:24945:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790711917.872283:0:24945:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790711917.872292:0:24945:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9dab82e88800 10000000:01000000:3.0:1790711917.872295:0:24945:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9dab82e88800 10000000:01000000:3.0:1790711917.872300:0:24945:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790711917.872306:0:24945:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9dab82e88800 from 1 10000000:01000000:3.0:1790711917.872308:0:24945:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790711917.873214:0:24945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185e00/0xcf3cf816241e0d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711917.873230:0:24945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dacb5185e00/0xcf3cf816241e0d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711917.873244:0:24945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dacb5185e00/0xcf3cf816241e0d68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711917.873271:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790711917.873338:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.873392:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb47626c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790711917.873716:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879792384 00000100:00100000:1.0:1790711917.873724:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879792384 00000100:00100000:1.0:1790711917.873772:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790711917.873780:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:24945:x1877696879792384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790711917.873795:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711917.873809:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0d68 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.873833:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0d68 expref: 24 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.873843:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacbcb74e00/0xcf3cf816241e0d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0d68 expref: 24 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.873850:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacbcb74e00, rc 0) 00000100:00100000:1.0:1790711917.873904:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879792384:12345-0@lo:101:mount.lustre.0 Request processed in 125us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711917.873911:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790711917.874121:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790711917.874138:0:24945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dacb5185e00/0xcf3cf816241e0d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0d6f expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711917.874146:0:24945:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dacb5185e00/0xcf3cf816241e0d68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0d6f expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790711917.877575:0:24945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1790711917.878037:0:24945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790711917.878324:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1790711917.878350:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1790711917.878569:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1790711917.878675:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1790711917.878693:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1790711917.878706:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1790711917.878719:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1790711917.878732:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1790711917.878745:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1790711917.878758:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1790711917.878772:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1790711917.878785:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1790711917.878798:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1790711917.878812:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1790711917.878825:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1790711917.878849:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1790711917.878863:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1790711917.878876:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1790711917.878888:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1790711917.879701:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1790711917.879732:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1790711917.879747:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1790711917.879761:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1790711917.879776:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1790711917.879790:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1790711917.879804:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1790711917.879819:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1790711917.879833:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1790711917.879847:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1790711917.879862:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1790711917.879876:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1790711917.879890:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1790711917.879905:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1790711917.880341:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1790711917.880674:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1790711917.880714:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1790711917.880730:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1790711917.880744:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1790711917.880759:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1790711917.880773:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1790711917.880787:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1790711917.880801:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1790711917.880815:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1790711917.880828:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1790711917.880842:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1790711917.880855:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1790711917.880869:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1790711917.880882:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1790711917.881821:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1790711917.881849:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1790711917.881882:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1790711917.881888:0:24945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1790711917.882865:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5342a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790711917.883343:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711917.883873:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac85770f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790711917.887755:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879792512 00000100:00100000:0.0:1790711917.887771:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879792512 00000100:00100000:0.0:1790711917.887830:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790711917.887842:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879792512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790711917.888141:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879792512:12345-0@lo:501:mount.lustre.0 Request processed in 301us (4797us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711917.888161:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790711917.889956:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5342a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790711917.890011:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5342a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790711917.890075:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711917.890115:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac85770f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790711917.890150:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879792640 00000100:00100000:3.0:1790711917.890157:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879792640 00000100:00100000:3.0:1790711917.890209:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790711917.890218:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879792640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790711917.890333:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879792640:12345-0@lo:503:mount.lustre.0 Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711917.890341:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790711917.890454:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5342a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792640:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790711917.890936:0:24945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790711917.891008:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5342a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790711917.891052:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.891085:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879792768 00000100:00100000:2.0:1790711917.891089:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac85770d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790711917.891091:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879792768 00000100:00100000:0.0:1790711917.891131:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790711917.891140:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879792768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790711917.891316:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879792768:12345-0@lo:502:mount.lustre.0 Request processed in 176us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711917.891324:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790711917.891459:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5342a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790711917.891795:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1790711917.891820:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1790711917.891836:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1790711917.891849:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1790711917.891875:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1790711917.891890:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1790711917.891904:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1790711917.891917:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1790711917.891931:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1790711917.891944:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1790711917.891958:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1790711917.891991:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1790711917.892022:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1790711917.892490:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1790711917.892515:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1790711917.892532:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1790711917.892572:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1790711917.892589:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1790711917.892603:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1790711917.892616:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1790711917.892630:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1790711917.892644:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1790711917.892658:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1790711917.892674:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1790711917.892689:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1790711917.892703:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1790711917.892717:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1790711917.892747:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1790711917.892764:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1790711917.892778:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1790711917.892792:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1790711917.892806:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1790711917.892820:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1790711917.892834:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1790711917.892848:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1790711917.892861:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1790711917.892875:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1790711917.892901:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1790711917.892916:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1790711917.892930:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1790711917.892941:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1790711917.892953:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1790711917.892966:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1790711917.892996:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1790711917.893026:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1790711917.894200:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1790711917.894235:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1790711917.894251:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1790711917.894307:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790711917.895720:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.895774:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac98a2f540 going to sleep for 11 seconds 00000100:00100000:2.0:1790711917.896001:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879792896 00000100:00100000:2.0:1790711917.896011:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879792896 00000100:00100000:2.0:1790711917.896065:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790711917.896075:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879792896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790711917.896229:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879792896:12345-0@lo:502:mount.lustre.0 Request processed in 156us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.896313:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790711917.896706:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879792896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790711917.896992:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1790711917.897027:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1790711917.897063:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879793024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790711917.897111:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.897832:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac98a2f540 going to sleep for 11 seconds 00000100:00100000:2.0:1790711917.899022:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879793024 00000100:00100000:2.0:1790711917.899034:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879793024 00000100:00100000:2.0:1790711917.899134:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790711917.899144:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879793024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790711917.899564:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879793024:12345-0@lo:502:mount.lustre.0 Request processed in 421us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.899572:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790711917.903808:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879793024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790711917.904199:0:24945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1790711917.904216:0:24945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790711917.905854:0:24958:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790711917.905876:0:24958:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9dab8339b380) 00000020:00000080:3.0:1790711917.905903:0:24958:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1790711917.906235:0:24958:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dab82e88800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790711917.906240:0:24958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dab82e88800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790711917.906242:0:24958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dab82e88800 3 00010000:00080000:3.0:1790711917.906273:0:24958:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dab81e6a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.106@tcp at head 00010000:00010000:2.0:1790711917.912738:0:24958:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1790711917.914724:0:24958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790711917.914779:0:24958:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790711917.914793:0:24958:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcf3cf816241e0d7d 00000100:00080000:2.0:1790711917.914804:0:24958:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790711917.914814:0:24958:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9dab81e6a800 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1790711917.914848:0:24958:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dacb5343800 x1877696879793152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790711917.914887:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1877696879793152:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790711917.915118:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790711917.915184:0:24958:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790711917.915593:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879793152 00000100:00100000:1.0:1790711917.915602:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879793152 00000100:00100000:1.0:1790711917.915638:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790711917.915647:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3606:x1877696879793152:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790711917.915672:0:22623:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:1.0:1790711917.915796:0:22623:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcf3cf816241e0d84 00000004:00100000:1.0:1790711917.915812:0:22623:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790711917.915848:0:22623:0:(import.c:65:import_set_state_nolock()) ffff9dacb49aa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790711917.915905:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1877696879793152:12345-0@lo:38:llog_process_th.0 Request processed in 258us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711917.916172:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790711917.916223:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790711917.916227:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790711917.916230:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790711917.916234:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:1.0:1790711917.916238:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1790711917.916244:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dab81c7d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1790711917.916259:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab81cced80 x1877696879793664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790711917.917183:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879793664:0@lo:8:kworker.0 00000100:00100000:2.0:1790711917.917247:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790711917.917292:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dacb5343800 x1877696879793152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790711927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711917.917303:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790711917.917312:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1790711917.917320:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790711917.917325:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790711917.917328:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab81e6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790711917.917335:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3606:1877696879793152:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790711917.917374:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879793280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790711917.917411:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711917.917444:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790711917.917451:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1877696879793792:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.917476:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711917.917501:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879793536:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.917524:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711917.917567:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790711917.917573:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879793408:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.917596:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.918869:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879793664 00000100:00100000:3.0:1790711917.918881:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879793664 00000100:00100000:3.0:1790711917.918940:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879793536 00000100:00100000:3.0:1790711917.918944:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879793536 00000100:00100000:3.0:1790711917.918980:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790711917.918990:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879793536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711917.919083:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879793536:12345-0@lo:400:kworker.0 Request processed in 95us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711917.919089:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790711917.919106:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790711917.919110:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5340e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3606:x1877696879793664:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1790711917.919158:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5340e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3606:x1877696879793664:12345-0@lo:8:kworker.0 Request processed in 46us (1911us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790711917.919164:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790711917.919183:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790711917.919214:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879793536:0@lo:400:kworker.0 00000100:00100000:3.0:1790711917.919243:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790711917.919250:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790711917.919254:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790711917.919257:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879793664:0@lo:8:kworker.0 00000100:00100000:0.0:1790711917.919457:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1790711917.919681:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790711917.919685:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790711917.919688:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dacb520d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790711917.919693:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 678 00000100:00080000:1.0:1790711917.919698:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1790711917.919705:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dacb520d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:1.0:1790711917.919726:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab81ccc700 x1877696879794304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790711917.920011:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879794048:0@lo:400:kworker.0 00000100:00100000:3.0:1790711917.920067:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.920096:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1877696879794688:0@lo:400:kworker.0 00000100:00100000:3.0:1790711917.920122:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.920143:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790711917.920149:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879794176:0@lo:400:kworker.0 00000100:00100000:3.0:1790711917.920172:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.920201:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879794304:0@lo:8:kworker.0 00000100:00100000:3.0:1790711917.920239:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.920268:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879793408 00000100:00100000:3.0:1790711917.920273:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879793408 00000100:00100000:3.0:1790711917.920301:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879794048 00000100:00100000:3.0:1790711917.920304:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879794048 00000100:00100000:3.0:1790711917.920323:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790711917.920329:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879793408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.920772:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879793280 00000100:00100000:2.0:1790711917.920777:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879793280 00000100:00100000:2.0:1790711917.920817:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790711917.920825:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879793280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790711917.920850:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790711917.920894:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879793280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.920900:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790711917.920935:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879793792 00000100:00100000:2.0:1790711917.920939:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879793792 00000100:00100000:2.0:1790711917.920964:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879794688 00000100:00100000:2.0:1790711917.920966:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879794688 00000100:00100000:2.0:1790711917.920993:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790711917.920998:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1877696879793792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.921203:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1877696879793792:12345-0@lo:400:kworker.0 Request processed in 204us (3726us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.921211:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790711917.921224:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790711917.921241:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877696879794688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.921277:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877696879794688:12345-0@lo:400:kworker.0 Request processed in 37us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.921283:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790711917.921301:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879794176 00000100:00100000:2.0:1790711917.921304:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879794176 00000100:00100000:2.0:1790711917.921324:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879794304 00000100:00100000:2.0:1790711917.921327:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879794304 00000100:00100000:2.0:1790711917.921337:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790711917.921356:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879794176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.921387:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879794176:12345-0@lo:400:kworker.0 Request processed in 43us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.921393:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790711917.921404:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790711917.921407:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1877696879794304:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1790711917.921461:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3606:x1877696879794304:12345-0@lo:8:kworker.0 Request processed in 52us (1222us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790711917.921467:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790711917.921484:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790711917.921492:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879794048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.921519:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879794048:12345-0@lo:400:kworker.0 Request processed in 28us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.921524:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790711917.921572:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879794560:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.921606:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790711917.921637:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab81ccf800 x1877696879793792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711917.921656:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1877696879793792:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.921676:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879793280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790711917.921696:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790711917.921701:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1877696879794432:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.921725:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711917.921746:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879794560 00000100:00100000:2.0:1790711917.921750:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879794560 00000100:00100000:2.0:1790711917.921767:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879794432 00000100:00100000:2.0:1790711917.921770:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879794432 00000100:00100000:2.0:1790711917.921782:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790711917.921788:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1877696879794560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.921820:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1877696879794560:12345-0@lo:400:kworker.0 Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.921826:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790711917.921837:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790711917.921843:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1877696879794432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.921876:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1877696879794432:12345-0@lo:400:kworker.0 Request processed in 33us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.921882:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1790711917.921896:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790711917.921900:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790711917.921902:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790711917.922233:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879794176:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.922244:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879794048:0@lo:400:kworker.0 00010000:00080000:2.0:1790711917.922272:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab81ccf100 x1877696879794688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711917.922281:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1877696879794688:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.922311:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790711917.922316:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacb520d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790711917.922320:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790711917.922323:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879794304:0@lo:8:kworker.0 00010000:00080000:2.0:1790711917.922414:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab81ccce00 x1877696879794432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711917.922424:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1877696879794432:0@lo:400:kworker.0 00010000:00080000:2.0:1790711917.922444:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab81ccd880 x1877696879794560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711917.922451:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879794560:0@lo:400:kworker.0 00000100:00100000:3.0:1790711917.924138:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879793408:12345-0@lo:400:kworker.0 Request processed in 3801us (6533us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711917.924151:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790711917.924417:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879793408:0@lo:400:kworker.0 00000020:01000004:3.0:1790711917.924733:0:24958:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790711917.924750:0:24958:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9dab83398000) 00000020:00000080:3.0:1790711917.924775:0:24958:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1790711917.924857:0:24958:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9dab82e88800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790711917.924861:0:24958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9dab82e88800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790711917.924864:0:24958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9dab82e88800 3 00010000:00080000:3.0:1790711917.924891:0:24958:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9dab81e6b000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.106@tcp at head 00010000:00010000:3.0:1790711917.926631:0:24958:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:0.0:1790711917.929069:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb5341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879793920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790711917.929142:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.929212:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879793920 00000100:00100000:0.0:1790711917.929219:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879793920 00000100:00100000:0.0:1790711917.929265:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790711917.929274:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879793920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790711917.929296:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790711917.929338:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879793920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711917.929359:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790711917.929409:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb5341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879793920:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1790711917.934384:0:24958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1790711917.934441:0:24958:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790711917.934453:0:24958:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcf3cf816241e0d92 00000100:00080000:3.0:1790711917.934465:0:24958:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790711917.934477:0:24958:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9dab81e6b000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711917.934512:0:24958:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab81ccad80 x1877696879794816/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790711917.934600:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1877696879794816:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790711917.934670:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790711917.934759:0:24958:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790711917.934827:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790711917.934836:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790711917.934839:0:38:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790711917.934847:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dab81c7d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:3.0:1790711917.934861:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab838e5880 x1877696879795328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790711917.934939:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790711917.934951:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bc8ed208-5edc-469a-a5f9-449dbe325e20:3607:1877696879794944:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.934984:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711917.935010:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879795200:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.935035:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711917.935054:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790711917.935059:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879795072:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.935081:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711917.935109:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879794944 00000100:00100000:2.0:1790711917.935115:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879794944 00000100:00100000:2.0:1790711917.935163:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790711917.935172:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3607:x1877696879794944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.935219:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3607:x1877696879794944:12345-0@lo:400:kworker.0 Request processed in 48us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.935226:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790711917.935254:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879795200 00000100:00100000:2.0:1790711917.935258:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879795200 00000100:00100000:2.0:1790711917.935283:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790711917.935289:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879795200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.935322:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879795200:12345-0@lo:400:kworker.0 Request processed in 34us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.935328:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790711917.935343:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879795072 00000100:00100000:2.0:1790711917.935346:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879795072 00000100:00100000:2.0:1790711917.935367:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790711917.935373:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879795072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.935404:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879795072:12345-0@lo:400:kworker.0 Request processed in 31us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711917.935409:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790711917.935624:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bc8ed208-5edc-469a-a5f9-449dbe325e20:3607:1877696879794944:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.935654:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879795072:0@lo:400:kworker.0 00000100:00100000:2.0:1790711917.935663:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879795200:0@lo:400:kworker.0 00000100:00100000:0.0:1790711917.938024:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879795328:0@lo:8:kworker.0 00000100:00100000:0.0:1790711917.938102:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.938170:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879794816 00000100:00100000:0.0:1790711917.938178:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879794816 00000100:00100000:0.0:1790711917.938219:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790711917.938227:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3606:x1877696879794816:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790711917.938262:0:22623:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:0.0:1790711917.938301:0:22623:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcf3cf816241e0d99 00000004:00100000:0.0:1790711917.938317:0:22623:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1790711917.939196:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879795584:0@lo:400:kworker.0 00000100:00100000:3.0:1790711917.939247:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.939272:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790711917.939278:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1877696879795456:0@lo:400:kworker.0 00000100:00100000:3.0:1790711917.939298:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711917.939325:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879795328 00000100:00100000:3.0:1790711917.939330:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879795328 00000100:00080000:0.0:1790711917.939500:0:22623:0:(import.c:65:import_set_state_nolock()) ffff9dab81dcd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790711917.939581:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877696879794816:12345-0@lo:38:llog_process_th.0 Request processed in 1352us (4909us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711917.939589:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790711917.939610:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879795584 00000100:00100000:0.0:1790711917.939613:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879795584 00000100:00100000:0.0:1790711917.939641:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879795456 00000100:00100000:0.0:1790711917.939644:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879795456 00000100:00100000:0.0:1790711917.939657:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790711917.939663:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1877696879795584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711917.939698:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1877696879795584:12345-0@lo:400:kworker.0 Request processed in 35us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711917.939705:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790711917.939717:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790711917.939722:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1877696879795456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711917.939748:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1877696879795456:12345-0@lo:400:kworker.0 Request processed in 27us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711917.939755:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790711917.939791:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790711917.939796:0:24130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1877696879795328:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790711917.939840:0:24130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1877696879795328:12345-0@lo:8:kworker.0 Request processed in 43us (1738us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790711917.939847:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1790711917.939879:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790711917.939904:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab838e7800 x1877696879795456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790711917.940094:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790711917.940100:0:3606:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790711917.940103:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879795328:0@lo:8:kworker.0 00010000:00080000:1.0:1790711917.940118:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab81ccad80 x1877696879794816/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790711927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711917.940138:0:3606:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790711917.940145:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1790711917.940151:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790711917.940156:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790711917.940158:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab81e6b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790711917.940163:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3606:1877696879794816:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790711917.940690:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1877696879795456:0@lo:400:kworker.0 00010000:00080000:0.0:1790711917.940715:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9dab838e5f80 x1877696879795584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711917.940725:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879795584:0@lo:400:kworker.0 00000040:00080000:2.0:1790711917.941599:0:24958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1790711917.941813:0:24945:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790711917.941847:0:24945:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790711917.941872:0:24945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185e00/0xcf3cf816241e0d68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0d6f expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.941883:0:24945:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dacb5185e00/0xcf3cf816241e0d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0d6f expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790711917.942038:0:24945:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790711917.942041:0:24945:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790711917.942042:0:24945:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790711917.942044:0:24945:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790711917.942045:0:24945:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790711917.942046:0:24945:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790711917.942048:0:24945:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790711917.942049:0:24945:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790711917.942050:0:24945:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790711917.942059:0:24945:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1790711917.942061:0:24945:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790711917.942063:0:24945:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790711917.942063:0:24945:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790711917.942064:0:24945:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790711917.942065:0:24945:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790711917.942066:0:24945:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790711917.942067:0:24945:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790711917.942067:0:24945:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790711917.942068:0:24945:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790711917.942092:0:24945:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790711917.942109:0:24945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879795712:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790711917.942170:0:24945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.942246:0:24945:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca014a000 going to sleep for 11 seconds 00000100:00100000:2.0:1790711917.945656:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879795712 00000100:00100000:2.0:1790711917.945672:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879795712 00000100:00100000:2.0:1790711917.945745:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790711917.945763:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879795712:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790711917.945798:0:22613:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790711917.945812:0:22613:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790711917.952796:0:22613:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790711917.952817:0:22613:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1790711917.953161:0:22637:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790711917.953166:0:22637:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790711917.953189:0:22637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.953209:0:22637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0c2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0c26 expref: 24 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.953217:0:22637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0c34 expref: 24 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.953225:0:22637:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.953270:0:22637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0c34 expref: 24 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.953285:0:22637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0c3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0c34 expref: 24 pid: 22613 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711917.953299:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879795840:0@lo:104: 00000100:00100000:0.0:1790711917.953486:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:24945:x1877696879795712:12345-0@lo:253:mount.lustre.0 Request processed in 7722us (11314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711917.953498:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790711917.953655:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790711917.953716:0:22637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0c26 expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.953725:0:22637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0c2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0c26 expref: 23 pid: 22615 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711917.953734:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879795968:0@lo:104: 00000100:00100000:1.0:1790711917.953754:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711917.953768:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84fd4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790711917.953868:0:24945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bc8ed208-5edc-469a-a5f9-449dbe325e20:24945:1877696879795712:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790711917.953881:0:24945:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790711917.953884:0:24945:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790711917.953886:0:24945:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790711917.953887:0:24945:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790711917.953889:0:24945:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790711917.953890:0:24945:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790711917.953892:0:24945:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790711917.953893:0:24945:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790711917.953895:0:24945:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790711917.953897:0:24945:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790711917.953998:0:24945:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1790711917.954648:0:22605:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879795840 00000100:00100000:3.0:1790711917.954655:0:22605:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879795840 00000100:00100000:3.0:1790711917.954685:0:22605:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879795968 00000100:00100000:3.0:1790711917.954688:0:22605:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879795968 00000100:00100000:3.0:1790711917.954700:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790711917.954708:0:22605:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+4:22637:x1877696879795840:12345-0@lo:104: 00010000:00010000:3.0:1790711917.954722:0:22605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711917.954858:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879795840:0@lo:104: 00010000:00010000:3.0:1790711917.955493:0:22605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790711917.955501:0:22605:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+4:22637:x1877696879795840:12345-0@lo:104: Request processed in 794us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711917.955510:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790711917.955530:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790711917.955648:0:22605:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:22637:x1877696879795968:12345-0@lo:104: 00010000:00010000:3.0:1790711917.955672:0:22605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711917.955769:0:22605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790711917.955774:0:22605:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:22637:x1877696879795968:12345-0@lo:104: Request processed in 239us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711917.955780:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1790711917.955831:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790711917.955837:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.955845:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7200 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711917.955849:0:22610:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.955858:0:22610:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711917.955866:0:22610:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711917.955884:0:22610:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790711917.955923:0:22610:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.955929:0:22610:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711917.955949:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.955956:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac9bef7200/0xcf3cf816241e0c34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0c3b expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.955969:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711917.955972:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.955977:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb74a00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711917.955980:0:22610:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.955986:0:22610:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711917.955992:0:22610:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711917.955997:0:22610:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790711917.956020:0:22610:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956026:0:22610:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711917.956049:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956055:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74a00/0xcf3cf816241e0c26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0c2d expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956069:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711917.956071:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711917.956073:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711917.956095:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879796224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711917.956130:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.956166:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790711917.956172:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879796096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711917.956193:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711917.956222:0:23376:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879796224 00000100:00100000:0.0:1790711917.956226:0:23376:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879796224 00010000:00010000:2.0:1790711917.956252:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711917.956260:0:23376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0c2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0c26 expref: 24 pid: 22615 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711917.956278:0:23376:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879796096 00000100:00100000:0.0:1790711917.956281:0:23376:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879796096 00010000:00010000:0.0:1790711917.956291:0:23376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0c3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0c34 expref: 25 pid: 22613 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711917.956306:0:23376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790711917.956312:0:23376:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc8ed208-5edc-469a-a5f9-449dbe325e20+25:3610:x1877696879796224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790711917.956322:0:23376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711917.956327:0:23376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0c2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0c26 expref: 25 pid: 22615 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956346:0:23376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0c2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0c26 expref: 25 pid: 22615 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956366:0:23376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790711917.956396:0:23376:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc8ed208-5edc-469a-a5f9-449dbe325e20+25:3610:x1877696879796224:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711917.956403:0:23376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790711917.956417:0:23376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790711917.956626:0:23376:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3610:x1877696879796096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790711917.956636:0:23376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711917.956641:0:23376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0c3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0c34 expref: 24 pid: 22613 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956650:0:23376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0c34 expref: 24 pid: 22613 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956660:0:23376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacbcb75400/0xcf3cf816241e0c3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0c34 expref: 24 pid: 22613 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956670:0:23376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956678:0:23376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790711917.956690:0:23376:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004471606s 00010000:00010000:0.0:1790711917.956695:0:23376:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956709:0:23376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956715:0:23376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956721:0:23376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956726:0:23376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb75000 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711917.956729:0:23376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956736:0:23376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956743:0:23376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711917.956751:0:23376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790711917.956776:0:23376:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:3610:x1877696879796096:12345-0@lo:103:ldlm_bl.0 Request processed in 353us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711917.956782:0:23376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790711917.956822:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879796096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711917.956829:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879796224:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1790711917.957500:0:24945:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:1.0:1790711917.959714:0:22637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0c2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0c26 expref: 22 pid: 22615 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711917.959735:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22637:1877696879795968:0@lo:104: 00010000:00010000:1.0:1790711917.959765:0:22637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.959775:0:22637:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.959782:0:22637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711917.959789:0:22637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacbcb75000/0xcf3cf816241e0da0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1790711917.965479:0:24945:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790711917.965489:0:24945:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790711917.965526:0:24945:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790711917.965659:0:24945:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790711917.965675:0:24945:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1790711917.965699:0:24945:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1790711917.966676:0:24945:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790711917.966916:0:24945:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790711918.685449:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711918.944152:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879796352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790711918.944223:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711918.948465:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879796480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790711918.948568:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711918.948749:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879796352 00000100:00100000:0.0:1790711918.948758:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879796352 00000100:00100000:0.0:1790711918.948801:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879796480 00000100:00100000:0.0:1790711918.948805:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879796480 00000100:00100000:0.0:1790711918.948822:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790711918.948830:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879796352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790711918.948864:0:22626:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790711918.948913:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879796352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (4690us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711918.948920:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790711918.948937:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790711918.948943:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879796480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790711918.949003:0:22626:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790711918.949037:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879796480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711918.949043:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790711918.949629:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879796352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790711918.951858:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879796480:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1790711918.986188:0:25012:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790711918.986410:0:25012:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1790711919.135885:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790711919.706790:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790711919.834626:0:22619:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790711919.834634:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dacb5208000 from 14 10000000:01000000:3.0:1790711919.834640:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790711919.834684:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185c00/0xcf3cf816241e0da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711919.834696:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dacb5185c00/0xcf3cf816241e0da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711919.834707:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dacb5185c00/0xcf3cf816241e0da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711919.834733:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879796608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790711919.834799:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711919.834844:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacaf9dea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790711919.834903:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879796608 00000100:00100000:2.0:1790711919.834911:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879796608 00000100:00100000:2.0:1790711919.834976:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790711919.834986:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:22619:x1877696879796608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790711919.835008:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711919.835022:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab82d15400/0xcf3cf816241e0dae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0da7 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711919.835046:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab82d15400/0xcf3cf816241e0dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0da7 expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711919.835057:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab82d15400/0xcf3cf816241e0dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0da7 expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711919.835067:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d15400, rc 0) 00000100:00100000:2.0:1790711919.835109:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:22619:x1877696879796608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711919.835116:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790711919.835601:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879796608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790711919.835617:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dacb5185c00/0xcf3cf816241e0da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0dae expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711919.835638:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dacb5185c00/0xcf3cf816241e0da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0dae expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711919.835704:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879796736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790711919.835737:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711919.835756:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacaf9dea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790711919.836094:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879796736 00000100:00100000:2.0:1790711919.836101:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879796736 00000100:00100000:2.0:1790711919.836145:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790711919.836153:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:22619:x1877696879796736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790711919.836171:0:22613:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790711919.836189:0:22613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790711919.836192:0:22613:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1790711919.836291:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:22619:x1877696879796736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711919.836299:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790711919.836382:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879796736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790711919.836462:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790711919.836470:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185c00/0xcf3cf816241e0da7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0dae expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711919.836479:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dacb5185c00/0xcf3cf816241e0da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0dae expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790711919.836488:0:22619:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790711919.836490:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9dacae5ff800 from 14 10000000:01000000:3.0:1790711919.836493:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790711919.836515:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185600/0xcf3cf816241e0db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711919.836523:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dacb5185600/0xcf3cf816241e0db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711919.836531:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dacb5185600/0xcf3cf816241e0db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711919.836574:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879796864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790711919.836601:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711919.836628:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacaf9dea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790711919.836742:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879796864 00000100:00100000:2.0:1790711919.836747:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879796864 00000100:00100000:2.0:1790711919.836780:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790711919.836786:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:22619:x1877696879796864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790711919.836803:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711919.836814:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab82d14600/0xcf3cf816241e0dbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0db5 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711919.836832:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab82d14600/0xcf3cf816241e0dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0db5 expref: 24 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711919.836841:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab82d14600/0xcf3cf816241e0dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0db5 expref: 24 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711919.836849:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d14600, rc 0) 00000100:00100000:2.0:1790711919.836876:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:22619:x1877696879796864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711919.836882:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790711919.842438:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879796864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790711919.842473:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dacb5185600/0xcf3cf816241e0db5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0dbc expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711919.842486:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dacb5185600/0xcf3cf816241e0db5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0dbc expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711919.842580:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879796992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790711919.842642:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711919.842685:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacaf9dea80 going to sleep for 11 seconds 00000100:00100000:1.0:1790711919.842828:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879796992 00000100:00100000:1.0:1790711919.842836:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879796992 00000100:00100000:1.0:1790711919.842888:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790711919.842898:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:22619:x1877696879796992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790711919.842918:0:22615:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790711919.842934:0:22615:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790711919.842938:0:22615:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1790711919.843034:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:22619:x1877696879796992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711919.843043:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790711919.843239:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879796992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790711919.843295:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790711919.843303:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5185600/0xcf3cf816241e0db5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0dbc expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711919.843312:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dacb5185600/0xcf3cf816241e0db5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0dbc expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711920.732727:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711921.754862:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711922.778791:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711923.036123:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879797120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790711923.036197:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711923.036260:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879797120 00000100:00100000:3.0:1790711923.036268:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879797120 00000100:00100000:3.0:1790711923.036322:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790711923.036332:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879797120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790711923.036360:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790711923.036417:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879797120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711923.036424:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1790711923.036458:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790711923.036498:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879797120:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790711923.036614:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711923.036619:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790711923.036622:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790711923.036632:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9dab81c7d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1790711923.036652:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab81cc8700 x1877696879797504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790711923.036687:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790711923.036690:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790711923.036692:0:8:0:(import.c:65:import_set_state_nolock()) ffff9dacb520d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790711923.036698:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9dacb520d000 using connection 192.168.203.106@tcp/0@lo 00000100:00100000:2.0:1790711923.036709:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9dab83226300 x1877696879798016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790711923.036764:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1877696879797632:0@lo:400:kworker.0 00000100:00100000:2.0:1790711923.036796:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711923.036818:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1877696879798272:0@lo:400:kworker.0 00000100:00100000:2.0:1790711923.036839:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711923.036860:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790711923.036866:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879797376:0@lo:400:kworker.0 00000100:00100000:2.0:1790711923.036890:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711923.036930:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879798144:0@lo:400:kworker.0 00000100:00100000:2.0:1790711923.036952:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711923.038293:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879798656:0@lo:400:kworker.0 00000100:00100000:2.0:1790711923.038339:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711923.038376:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879797504:0@lo:8:kworker.0 00000100:00100000:2.0:1790711923.038411:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711923.038432:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83226300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879798016:0@lo:8:kworker.0 00000100:00100000:2.0:1790711923.040451:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711923.040523:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879797632 00000100:00100000:2.0:1790711923.040532:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879797632 00000100:00100000:2.0:1790711923.040586:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879798272 00000100:00100000:2.0:1790711923.040589:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879798272 00000100:00100000:2.0:1790711923.040608:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879798144 00000100:00100000:2.0:1790711923.040611:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879798144 00000100:00100000:2.0:1790711923.040623:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879798656 00000100:00100000:2.0:1790711923.040626:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879798656 00000100:00100000:2.0:1790711923.040643:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790711923.040652:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1877696879797632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711923.040733:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1877696879797632:12345-0@lo:400:kworker.0 Request processed in 81us (3935us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711923.040740:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790711923.040759:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790711923.040765:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1877696879798272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711923.040793:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1877696879798272:12345-0@lo:400:kworker.0 Request processed in 29us (3953us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711923.040799:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790711923.040810:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790711923.040815:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879798144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711923.040843:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879798144:12345-0@lo:400:kworker.0 Request processed in 28us (3890us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711923.040848:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790711923.040859:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790711923.040865:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1877696879798656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711923.040891:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1877696879798656:12345-0@lo:400:kworker.0 Request processed in 27us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711923.040896:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790711923.040919:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879797376 00000100:00100000:2.0:1790711923.040924:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879797376 00000100:00100000:2.0:1790711923.040947:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790711923.040954:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879797376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711923.040988:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879797376:12345-0@lo:400:kworker.0 Request processed in 34us (4097us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711923.040993:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790711923.041018:0:24130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879797504 00000100:00100000:2.0:1790711923.041023:0:24130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879797504 00000100:00100000:2.0:1790711923.041058:0:24130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879798016 00000100:00100000:2.0:1790711923.041062:0:24130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879798016 00000100:00100000:2.0:1790711923.041072:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790711923.041077:0:24130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1877696879797504:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790711923.041104:0:24130:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:2.0:1790711923.041130:0:24130:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3cf816241e0dc3 00002000:00100000:2.0:1790711923.041143:0:24130:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9dab82e8e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790711923.041147:0:24130:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790711923.041149:0:24130:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790711923.041318:0:24130:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790711923.041341:0:24130:0:(import.c:65:import_set_state_nolock()) ffff9dab82f17000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790711923.041382:0:24130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3606:x1877696879797504:12345-0@lo:8:kworker.0 Request processed in 303us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711923.041397:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790711923.041411:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790711923.041415:0:24130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3606:x1877696879798016:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790711923.041430:0:24130:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:2.0:1790711923.041445:0:24130:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3cf816241e0dca 00002000:00100000:2.0:1790711923.041451:0:24130:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9dab82f12800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1790711923.041454:0:24130:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1790711923.041456:0:24130:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790711923.041479:0:24130:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1790711923.041491:0:24130:0:(import.c:65:import_set_state_nolock()) ffff9dab82f16800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790711923.041520:0:24130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3606:x1877696879798016:12345-0@lo:8:kworker.0 Request processed in 104us (3065us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711923.041536:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1790711923.041606:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab81cc8700 x1877696879797504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790711948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790711923.041622:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790711923.041629:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790711923.041634:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790711923.041636:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dab81c7d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790711923.041651:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790711923.041656:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3606:1877696879797504:0@lo:8:kworker.0 00010000:00080000:2.0:1790711923.041670:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83226300 x1877696879798016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790711948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790711923.041679:0:3606:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1790711923.041684:0:3606:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790711923.041687:0:3606:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790711923.041688:0:3606:0:(import.c:65:import_set_state_nolock()) ffff9dacb520d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790711923.041707:0:3606:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790711923.041711:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83226300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3606:1877696879798016:0@lo:8:kworker.0 00000004:00080000:2.0:1790711923.041737:0:22648:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790711923.041794:0:22648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689126252764ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790711923.041801:0:22648:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1790711923.041964:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879797376:0@lo:400:kworker.0 00010000:00080000:2.0:1790711923.041977:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83227b80 x1877696879798144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711923.041987:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879798144:0@lo:400:kworker.0 00010000:00080000:2.0:1790711923.042010:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83225500 x1877696879798656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711923.042019:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879798656:0@lo:400:kworker.0 00010000:00080000:2.0:1790711923.042031:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83225f80 x1877696879797632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711923.042039:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1877696879797632:0@lo:400:kworker.0 00010000:00080000:2.0:1790711923.042049:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83224000 x1877696879798272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711923.042057:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1877696879798272:0@lo:400:kworker.0 00000100:00100000:3.0:1790711923.042249:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879797248:0@lo:400:kworker.0 00000100:00100000:3.0:1790711923.042292:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711923.042331:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879797888:0@lo:400:kworker.0 00000100:00100000:3.0:1790711923.042355:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711923.042376:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1877696879798528:0@lo:400:kworker.0 00000100:00100000:3.0:1790711923.042412:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711923.042433:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790711923.042440:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879797760:0@lo:400:kworker.0 00000100:00100000:3.0:1790711923.042462:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711923.042480:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1877696879798400:0@lo:400:kworker.0 00000100:00100000:3.0:1790711923.042500:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711923.042525:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879798528 00000100:00100000:3.0:1790711923.042529:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879798528 00000100:00100000:3.0:1790711923.042576:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879798400 00000100:00100000:3.0:1790711923.042578:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879798400 00000100:00100000:3.0:1790711923.042591:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790711923.042597:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1877696879798528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711923.042631:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3610:x1877696879798528:12345-0@lo:400:kworker.0 Request processed in 35us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711923.042637:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790711923.042650:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790711923.042655:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1877696879798400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711923.042676:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1877696879798400:12345-0@lo:400:kworker.0 Request processed in 21us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711923.042692:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790711923.042711:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879797888 00000100:00100000:3.0:1790711923.042714:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879797888 00000100:00100000:3.0:1790711923.042737:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790711923.042742:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879797888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711923.042768:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879797888:12345-0@lo:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711923.042774:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790711923.042787:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879797760 00000100:00100000:3.0:1790711923.042789:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879797760 00000100:00100000:3.0:1790711923.042812:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790711923.042818:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879797760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711923.042844:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879797760:12345-0@lo:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711923.042849:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1790711923.042869:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790711923.042873:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790711923.042875:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790711923.042897:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879797760:0@lo:400:kworker.0 00010000:00080000:3.0:1790711923.042906:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83224a80 x1877696879798400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711923.042915:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1877696879798400:0@lo:400:kworker.0 00000100:00100000:3.0:1790711923.042923:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879797888:0@lo:400:kworker.0 00010000:00080000:3.0:1790711923.042931:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83227800 x1877696879798528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711923.042950:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3610:1877696879798528:0@lo:400:kworker.0 00000004:00080000:0.0:1790711923.043155:0:23366:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1790711923.043172:0:23366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23366:1877696879798912:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1790711923.043201:0:23366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711923.043215:0:23366:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac83fab300 going to sleep for 11 seconds 00000004:00080000:0.0:1790711923.043226:0:23365:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790711923.043286:0:23365:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 689127744744ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790711923.043291:0:23365:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1790711923.043595:0:22649:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1790711923.043608:0:22649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22649:1877696879799168:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790711923.043636:0:22649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711923.043648:0:22649:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac83fab600 going to sleep for 11 seconds 00000100:00100000:2.0:1790711923.044082:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879797248 00000100:00100000:2.0:1790711923.044089:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879797248 00000100:00100000:2.0:1790711923.044132:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790711923.044145:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3610:x1877696879797248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711923.044198:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3610:x1877696879797248:12345-0@lo:400:kworker.0 Request processed in 58us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711923.044204:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790711923.044267:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879798784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790711923.044295:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711923.044521:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879798912 00000100:00100000:3.0:1790711923.044525:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879798912 00000100:00100000:3.0:1790711923.044585:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879799168 00000100:00100000:3.0:1790711923.044588:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879799168 00000100:00100000:3.0:1790711923.044604:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790711923.044610:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23366:x1877696879798912:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1790711923.044813:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879799040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790711923.044850:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711923.044879:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790711923.044885:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879799296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790711923.044911:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711923.044936:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879798784 00000100:00100000:3.0:1790711923.044951:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879799040 00000100:00100000:0.0:1790711923.044951:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879798784 00000100:00100000:3.0:1790711923.044961:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879799040 00000100:00100000:0.0:1790711923.044996:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879799296 00000100:00100000:0.0:1790711923.045002:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879799296 00000100:00100000:0.0:1790711923.045032:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790711923.045042:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3608:x1877696879798784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790711923.045075:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790711923.045158:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3608:x1877696879798784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711923.045207:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790711923.045231:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790711923.045247:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879799296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790711923.045266:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790711923.045315:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879799296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (403us total) trans 0 rc 0/0 00000100:00080000:2.0:1790711923.045377:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790711923.045427:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dacb51b5180 x1877696879798784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790711939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711923.045445:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879798784:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1790711923.046102:0:23355:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1790711923.046919:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bc8ed208-5edc-469a-a5f9-449dbe325e20:3610:1877696879797248:0@lo:400:kworker.0 00000004:00080000:0.0:1790711923.047078:0:22601:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1790711923.047344:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790711923.047378:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790711923.047403:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1877696879799040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790711923.047425:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790711923.047485:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1877696879799040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711923.047504:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790711923.047565:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879799296:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1790711923.047586:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab830bf480 x1877696879799040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790711939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711923.047603:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879799040:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1790711923.050237:0:24129:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1790711923.050245:0:24129:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1790711923.050341:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23366:x1877696879798912:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5727us (7135us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711923.050351:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790711923.050398:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790711923.050409:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22649:x1877696879799168:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:2.0:1790711923.050928:0:23366:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab830bf100 x1877696879798912/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790711939 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711923.050948:0:23366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23366:1877696879798912:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1790711923.050958:0:23366:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1790711923.051002:0:23366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83225f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23366:1877696879799424:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790711923.051037:0:23366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711923.051120:0:23366:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb465b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790711923.051315:0:24127:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790711923.051323:0:24127:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1790711923.051642:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879799424 00000100:00100000:2.0:1790711923.051649:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879799424 00000100:00100000:1.0:1790711923.051807:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790711923.051817:0:25210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23366:x1877696879799424:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1790711923.051838:0:25210:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1790711923.052012:0:25210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23366:x1877696879799424:12345-0@lo:5:osp-pre-1-1.0 Request processed in 195us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711923.052020:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1790711923.052085:0:23366:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83225f80 x1877696879799424/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790711939 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711923.052097:0:23366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83225f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23366:1877696879799424:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1790711923.052109:0:23366:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1790711923.052141:0:23366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83225f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23366:1877696879799552:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790711923.052166:0:23366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711923.052224:0:23366:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb465b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790711923.052263:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879799552 00000100:00100000:1.0:1790711923.052267:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879799552 00000100:00100000:1.0:1790711923.052328:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790711923.052335:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23366:x1877696879799552:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1790711923.052360:0:24127:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00080000:0.0:1790711923.053939:0:24129:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1790711923.053954:0:24129:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1790711923.053963:0:24129:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00010000:0.0:1790711923.068524:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790711923.069184:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f688c32c/0xcf3cf816241e0dd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.069208:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1790711923.069215:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790711923.069228:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f688c32c/0xcf3cf816241e0dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.069251:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f688c32c/0xcf3cf816241e0dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.069283:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f688c32c/0xcf3cf816241e0dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.069291:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f688c32c/0xcf3cf816241e0dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.069320:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790711923.070609:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790711923.070623:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b72960/0xcf3cf816241e0dd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.070638:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1790711923.070642:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790711923.070648:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068b72960/0xcf3cf816241e0dd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.070660:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068b72960/0xcf3cf816241e0dd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.070670:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068b72960/0xcf3cf816241e0dd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.070677:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068b72960/0xcf3cf816241e0dd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.070715:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1790711923.072672:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790711923.072688:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd74306a/0xcf3cf816241e0ddf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.072706:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1790711923.072711:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790711923.072718:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd74306a/0xcf3cf816241e0ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.072734:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd74306a/0xcf3cf816241e0ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.072746:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd74306a/0xcf3cf816241e0ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.072754:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd74306a/0xcf3cf816241e0ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.072767:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1790711923.075302:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790711923.075320:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb430768/0xcf3cf816241e0de6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.075834:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1790711923.075856:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790711923.075864:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb430768/0xcf3cf816241e0de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.075883:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb430768/0xcf3cf816241e0de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.075896:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb430768/0xcf3cf816241e0de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.075904:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb430768/0xcf3cf816241e0de6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.075920:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1790711923.076195:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790711923.076203:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f688c32c/0xcf3cf816241e0dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.076213:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef6000 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.076219:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f688c32c/0xcf3cf816241e0dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.076229:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f688c32c/0xcf3cf816241e0dd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.076283:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f688c32c/0xcf3cf816241e0dd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.076304:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f688c32c/0xcf3cf816241e0dd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.076334:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790711923.076339:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068b72960/0xcf3cf816241e0dd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790711923.076592:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.076603:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022844ec1/0xcf3cf816241e0ded lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.076620:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.076624:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.076630:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022844ec1/0xcf3cf816241e0ded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.076645:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022844ec1/0xcf3cf816241e0ded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.076655:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022844ec1/0xcf3cf816241e0ded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.076662:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022844ec1/0xcf3cf816241e0ded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.076671:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790711923.077148:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7e00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.077153:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b72960/0xcf3cf816241e0dd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077163:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068b72960/0xcf3cf816241e0dd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077180:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068b72960/0xcf3cf816241e0dd8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077189:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068b72960/0xcf3cf816241e0dd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077210:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790711923.077215:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd74306a/0xcf3cf816241e0ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077221:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7a00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.077235:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd74306a/0xcf3cf816241e0ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077244:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd74306a/0xcf3cf816241e0ddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077256:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd74306a/0xcf3cf816241e0ddf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077263:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd74306a/0xcf3cf816241e0ddf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077281:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790711923.077285:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb430768/0xcf3cf816241e0de6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077292:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7c00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.077296:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb430768/0xcf3cf816241e0de6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077304:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb430768/0xcf3cf816241e0de6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077315:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb430768/0xcf3cf816241e0de6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077322:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb430768/0xcf3cf816241e0de6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790711923.077346:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.077354:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000651cd771/0xcf3cf816241e0df4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.077375:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.077378:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.077382:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000651cd771/0xcf3cf816241e0df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.077401:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000651cd771/0xcf3cf816241e0df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.077409:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000651cd771/0xcf3cf816241e0df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.077416:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000651cd771/0xcf3cf816241e0df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.077425:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790711923.077431:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790711923.077438:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022844ec1/0xcf3cf816241e0ded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077450:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb75000 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.077454:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022844ec1/0xcf3cf816241e0ded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077463:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022844ec1/0xcf3cf816241e0ded lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077482:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022844ec1/0xcf3cf816241e0ded lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077491:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022844ec1/0xcf3cf816241e0ded lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077510:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711923.077515:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000651cd771/0xcf3cf816241e0df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077522:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb75400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.077526:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000651cd771/0xcf3cf816241e0df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077577:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000651cd771/0xcf3cf816241e0df4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077591:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000651cd771/0xcf3cf816241e0df4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.077600:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000651cd771/0xcf3cf816241e0df4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.077603:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.077625:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.077629:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.077631:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.077896:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.077903:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fdad72d/0xcf3cf816241e0dfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.077912:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.077915:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.077920:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fdad72d/0xcf3cf816241e0dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.077930:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fdad72d/0xcf3cf816241e0dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.077945:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fdad72d/0xcf3cf816241e0dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.077952:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fdad72d/0xcf3cf816241e0dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.077963:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790711923.078924:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.078933:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009acf33c2/0xcf3cf816241e0e02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.078944:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.078947:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.078952:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009acf33c2/0xcf3cf816241e0e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.078963:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009acf33c2/0xcf3cf816241e0e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.078970:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009acf33c2/0xcf3cf816241e0e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.078979:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009acf33c2/0xcf3cf816241e0e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.079007:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790711923.079098:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790711923.079106:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fdad72d/0xcf3cf816241e0dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.079114:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb74a00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711923.079119:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fdad72d/0xcf3cf816241e0dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.079127:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fdad72d/0xcf3cf816241e0dfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.079157:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fdad72d/0xcf3cf816241e0dfb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.079174:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fdad72d/0xcf3cf816241e0dfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.079194:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711923.079198:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009acf33c2/0xcf3cf816241e0e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.079204:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb75600 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711923.079207:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009acf33c2/0xcf3cf816241e0e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.079214:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009acf33c2/0xcf3cf816241e0e02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.079223:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009acf33c2/0xcf3cf816241e0e02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.079229:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009acf33c2/0xcf3cf816241e0e02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.079240:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711923.079242:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711923.079248:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.079482:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.079488:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058001c48/0xcf3cf816241e0e09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.079496:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.079499:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.079503:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058001c48/0xcf3cf816241e0e09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.079512:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058001c48/0xcf3cf816241e0e09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.079519:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058001c48/0xcf3cf816241e0e09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.079526:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058001c48/0xcf3cf816241e0e09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.079562:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790711923.079994:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711923.080009:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058001c48/0xcf3cf816241e0e09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.080035:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb74800 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.080040:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058001c48/0xcf3cf816241e0e09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.080053:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058001c48/0xcf3cf816241e0e09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.080076:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058001c48/0xcf3cf816241e0e09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.080107:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058001c48/0xcf3cf816241e0e09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790711923.080117:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.080127:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f4d4f7/0xcf3cf816241e0e10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.080136:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1790711923.080140:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.080144:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.080148:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.080152:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.080159:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091f4d4f7/0xcf3cf816241e0e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.080170:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091f4d4f7/0xcf3cf816241e0e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.080179:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f4d4f7/0xcf3cf816241e0e10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.080187:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091f4d4f7/0xcf3cf816241e0e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.080208:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790711923.080264:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711923.080272:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091f4d4f7/0xcf3cf816241e0e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.080282:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb75800 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.080287:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f4d4f7/0xcf3cf816241e0e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.080296:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f4d4f7/0xcf3cf816241e0e10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.080308:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091f4d4f7/0xcf3cf816241e0e10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.080317:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091f4d4f7/0xcf3cf816241e0e10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.080332:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.080334:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.080336:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711923.080422:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.080958:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.080968:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb7de81/0xcf3cf816241e0e17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.080979:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.080983:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.080988:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eb7de81/0xcf3cf816241e0e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.081000:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eb7de81/0xcf3cf816241e0e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.081009:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb7de81/0xcf3cf816241e0e17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.081038:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eb7de81/0xcf3cf816241e0e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.081064:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790711923.081524:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.081531:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000123aee0f/0xcf3cf816241e0e1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.081564:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.081569:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.081573:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000123aee0f/0xcf3cf816241e0e1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.081584:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000123aee0f/0xcf3cf816241e0e1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.081592:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000123aee0f/0xcf3cf816241e0e1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.081600:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000123aee0f/0xcf3cf816241e0e1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.081602:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711923.081618:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eb7de81/0xcf3cf816241e0e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.081627:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790711923.081632:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb74c00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.081640:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb7de81/0xcf3cf816241e0e17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.081650:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb7de81/0xcf3cf816241e0e17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.081669:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eb7de81/0xcf3cf816241e0e17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.081676:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eb7de81/0xcf3cf816241e0e17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.081705:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711923.081710:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000123aee0f/0xcf3cf816241e0e1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.081717:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb75a00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.081721:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000123aee0f/0xcf3cf816241e0e1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.081729:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000123aee0f/0xcf3cf816241e0e1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.081753:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000123aee0f/0xcf3cf816241e0e1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.081760:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000123aee0f/0xcf3cf816241e0e1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.081773:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.081775:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.081776:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.082326:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.082334:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e12c7f8/0xcf3cf816241e0e25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.082351:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.082355:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.082359:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e12c7f8/0xcf3cf816241e0e25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.082369:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e12c7f8/0xcf3cf816241e0e25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.082377:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e12c7f8/0xcf3cf816241e0e25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.082396:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e12c7f8/0xcf3cf816241e0e25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.082416:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790711923.082760:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.082766:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d430271f/0xcf3cf816241e0e2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.082775:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.082778:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.082782:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d430271f/0xcf3cf816241e0e2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.082846:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d430271f/0xcf3cf816241e0e2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.082866:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d430271f/0xcf3cf816241e0e2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.082874:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d430271f/0xcf3cf816241e0e2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.082882:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790711923.083046:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790711923.083058:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e12c7f8/0xcf3cf816241e0e25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.083069:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb75e00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.083074:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e12c7f8/0xcf3cf816241e0e25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.083086:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e12c7f8/0xcf3cf816241e0e25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.083105:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e12c7f8/0xcf3cf816241e0e25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.083113:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e12c7f8/0xcf3cf816241e0e25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.083159:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711923.083163:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d430271f/0xcf3cf816241e0e2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.083171:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac80031c00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.083175:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d430271f/0xcf3cf816241e0e2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.083184:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d430271f/0xcf3cf816241e0e2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.083196:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d430271f/0xcf3cf816241e0e2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.083203:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d430271f/0xcf3cf816241e0e2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.083235:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.083237:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.083239:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.083949:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790711923.084702:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790711923.084713:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000960942ff/0xcf3cf816241e0e33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.084732:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=689s v=(0 0) 00010000:00010000:0.0:1790711923.084747:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790711923.084755:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000960942ff/0xcf3cf816241e0e33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.084771:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000960942ff/0xcf3cf816241e0e33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.084782:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000960942ff/0xcf3cf816241e0e33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.084791:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000960942ff/0xcf3cf816241e0e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.084819:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790711923.085398:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790711923.085414:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000960942ff/0xcf3cf816241e0e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.085429:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef6600 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711923.085434:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000960942ff/0xcf3cf816241e0e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.085446:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000960942ff/0xcf3cf816241e0e33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.085469:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000960942ff/0xcf3cf816241e0e33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.085477:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000960942ff/0xcf3cf816241e0e33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.085508:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.085521:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.085523:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.088289:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.088304:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.088321:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.088326:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.088333:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.088347:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.088357:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.088366:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.088398:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790711923.088638:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790711923.088644:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.088653:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfa200 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711923.088658:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.088678:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.088695:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.088703:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.088738:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.088740:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.088741:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.089420:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.089428:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.089437:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.089440:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.089444:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.089453:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.089461:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.089476:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.089492:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790711923.089712:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790711923.089718:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.089726:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfac00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711923.089729:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.089738:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.089751:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.089758:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.089771:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.089773:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.089775:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.090216:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.090228:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.090237:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.090240:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.090244:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.090253:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.090261:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.090268:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.090280:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790711923.090378:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790711923.090396:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.090404:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfb800 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711923.090407:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.090415:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.090432:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.090440:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.090456:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.090458:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.090460:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.091892:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.091902:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.091915:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.091918:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.091924:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.091934:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.091942:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.091949:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.091975:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790711923.092019:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790711923.092024:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.092186:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfa800 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711923.092190:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.092199:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.092213:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.092220:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.092236:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.092238:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.092240:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.095592:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.095606:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.095624:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.095637:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.095643:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.095658:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.095669:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.095677:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.095695:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790711923.096527:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790711923.096537:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.096571:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfa600 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711923.096576:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.096587:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.096604:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.096625:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.096645:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.096647:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.096649:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.098310:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.098323:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.098338:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.098342:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.098347:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.098360:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.098368:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.098376:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.098405:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790711923.098602:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790711923.098616:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.098625:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfbe00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711923.098630:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.098638:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.098652:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.098659:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.098674:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.098675:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.098677:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.102708:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.102723:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.102740:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.102744:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.102751:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.102780:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.102806:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.102814:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.104155:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790711923.104668:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.104697:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.104713:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.104717:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.104723:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.104736:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.104746:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.104767:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.106138:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790711923.106149:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.106162:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfb800 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711923.106167:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.106178:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.106199:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.106206:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000844e80e3/0xcf3cf816241e0e64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.106228:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711923.106232:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.106238:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfac00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711923.106242:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.106263:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.106274:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e6b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.106282:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711923.106283:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711923.106285:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.106952:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790711923.107027:0:24129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.107643:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.107779:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.109488:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.109508:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.109513:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.109519:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.109532:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.109597:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.109606:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.111273:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1790711923.113810:0:24946:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1790711923.114370:0:24946:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1790711923.114378:0:24946:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1790711923.114583:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.114592:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.114611:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.114615:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.114621:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.114634:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.114644:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.114652:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711923.114901:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23366:x1877696879799552:12345-0@lo:5:osp-pre-1-1.0 Request processed in 62556us (62724us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1790711923.114920:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790711923.115012:0:23366:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1790711923.115303:0:23366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83225f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23366:1877696879799552:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1790711923.115326:0:23366:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1790711923.115457:0:23366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23366:1877696879799680:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1790711923.115511:0:23366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711923.115594:0:23366:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84fd4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790711923.115628:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879799680 00000100:00100000:0.0:1790711923.115637:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879799680 00000100:00100000:0.0:1790711923.115695:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790711923.115707:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23366:x1877696879799680:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1790711923.115790:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23366:x1877696879799680:12345-0@lo:900:osp-pre-1-1.0 Request processed in 83us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711923.115799:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790711923.115851:0:23366:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab830bfb80 x1877696879799680/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790711939 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711923.115863:0:23366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23366:1877696879799680:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1790711923.117045:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790711923.117058:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.117071:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfa800 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711923.117076:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.117086:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.117105:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.117112:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b555ce52/0xcf3cf816241e0e72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.117147:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711923.117151:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.117157:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfbe00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711923.117160:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.117167:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.117178:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e79 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.117185:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711923.117186:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711923.117188:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711923.117253:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790711923.117260:0:24129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091b70597/0xcf3cf816241e0e79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.117941:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.118517:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.118527:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.118581:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.118588:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.118595:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.118609:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.118618:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.118626:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.118647:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790711923.119484:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790711923.119492:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.119501:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfa600 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:2.0:1790711923.119505:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.119528:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.119560:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.119569:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb265fb8/0xcf3cf816241e0e80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711923.119591:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711923.119593:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711923.119595:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.119754:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.119761:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.119770:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.119774:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.121062:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.121083:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.121092:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.121100:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.121128:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790711923.121188:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711923.121205:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.121220:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfac00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711923.121225:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.121239:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.121264:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.121274:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032aba1e6/0xcf3cf816241e0e87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711923.121308:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.121310:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711923.121312:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.121922:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.121931:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.121943:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.121948:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.121953:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.122624:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.122640:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.122662:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.122686:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790711923.123504:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790711923.123512:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.123521:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfa200 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:3.0:1790711923.123526:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.123535:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.123585:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.123592:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e075a1d5/0xcf3cf816241e0e8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.123615:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711923.123617:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711923.123618:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.123755:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.123762:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f060b8a4/0xcf3cf816241e0e95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.123772:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.123776:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.123781:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f060b8a4/0xcf3cf816241e0e95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.123791:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f060b8a4/0xcf3cf816241e0e95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.123800:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f060b8a4/0xcf3cf816241e0e95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.123807:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f060b8a4/0xcf3cf816241e0e95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.123838:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790711923.124529:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790711923.124536:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f060b8a4/0xcf3cf816241e0e95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.124567:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfba00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:3.0:1790711923.124571:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f060b8a4/0xcf3cf816241e0e95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.124579:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f060b8a4/0xcf3cf816241e0e95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.124592:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f060b8a4/0xcf3cf816241e0e95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.124599:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f060b8a4/0xcf3cf816241e0e95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.124617:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711923.124619:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711923.124621:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.125138:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.125146:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027e8b0d/0xcf3cf816241e0e9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.125161:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.125165:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.125170:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027e8b0d/0xcf3cf816241e0e9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.125181:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000027e8b0d/0xcf3cf816241e0e9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.125189:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027e8b0d/0xcf3cf816241e0e9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.125195:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000027e8b0d/0xcf3cf816241e0e9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.125221:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790711923.126712:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790711923.126724:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000027e8b0d/0xcf3cf816241e0e9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.126734:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfb400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:3.0:1790711923.126738:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000027e8b0d/0xcf3cf816241e0e9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.126766:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000027e8b0d/0xcf3cf816241e0e9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.126794:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000027e8b0d/0xcf3cf816241e0e9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.126802:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000027e8b0d/0xcf3cf816241e0e9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.126836:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711923.126838:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711923.126840:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790711923.127205:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790711923.127212:0:24129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054c53e5d/0xcf3cf816241e0ea3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.127224:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1790711923.127228:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790711923.127234:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054c53e5d/0xcf3cf816241e0ea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.127245:0:24129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054c53e5d/0xcf3cf816241e0ea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.127265:0:24129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054c53e5d/0xcf3cf816241e0ea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.127273:0:24129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054c53e5d/0xcf3cf816241e0ea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711923.127297:0:24129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1790711923.127362:0:24129:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:1.0:1790711923.127486:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22649:x1877696879799168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 77076us (83844us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711923.127499:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790711923.127726:0:22649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22649:1877696879799168:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790711923.127756:0:22649:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1790711923.127828:0:22649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22649:1877696879799808:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790711923.127903:0:22649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711923.127958:0:22649:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac84fd4c00 going to sleep for 11 seconds 00010000:00010000:3.0:1790711923.128187:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790711923.128194:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054c53e5d/0xcf3cf816241e0ea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.128204:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfa400 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:3.0:1790711923.128208:0:22609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054c53e5d/0xcf3cf816241e0ea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.128216:0:22609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054c53e5d/0xcf3cf816241e0ea3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.128230:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054c53e5d/0xcf3cf816241e0ea3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.128253:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054c53e5d/0xcf3cf816241e0ea3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711923.128268:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711923.128270:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711923.128272:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711923.129130:0:25210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879799808 00000100:00100000:1.0:1790711923.129143:0:25210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879799808 00000100:00100000:1.0:1790711923.129209:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790711923.129219:0:25210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22649:x1877696879799808:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1790711923.129268:0:25210:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1790711923.138093:0:25210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22649:x1877696879799808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8870us (10184us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1790711923.138107:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790711923.143172:0:22649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22649:1877696879799808:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790711923.143200:0:22649:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1790711923.809403:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711924.059704:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790711924.059726:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879799936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790711924.059785:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711924.059831:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879799936 00000100:00100000:0.0:1790711924.059843:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879799936 00000100:00100000:0.0:1790711924.059886:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790711924.059905:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879799936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790711924.059938:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790711924.059977:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879799936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711924.059983:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790711924.060022:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879799936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790711924.066008:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879800064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790711924.066085:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711924.067772:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879800064 00000100:00100000:2.0:1790711924.067788:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879800064 00000100:00100000:2.0:1790711924.067850:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790711924.067860:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879800064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790711924.068061:0:23610:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790711924.069396:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879800064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1523us (3295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711924.069408:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790711924.074069:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879800064:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1790711924.735357:0:25302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg306-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790711924.827651:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790711924.894308:0:23375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1790711925.703902:0:25355:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790711925.704239:0:25355:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790711925.853872:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790711926.730975:0:25405:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790711926.731264:0:25405:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790711926.874751:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711926.974808:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711926.974910:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867093888 00000100:00100000:3.0:1790711926.974937:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867093888 00000100:00100000:3.0:1790711926.974997:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 114 00000100:00100000:3.0:1790711926.975010:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2406:x1877696867093888:12345-192.168.203.6@tcp:250:mount.lustre.0 00010000:00080000:3.0:1790711926.975058:0:22614:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b8a411b8-5cf6-4a02-9e5d-e280698795de@192.168.203.6@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1790711926.975096:0:22614:0:(genops.c:1384:class_connect()) connect: client b8a411b8-5cf6-4a02-9e5d-e280698795de, cookie 0xcf3cf816241e0eaa 00000100:00080000:3.0:1790711926.975281:0:22614:0:(import.c:65:import_set_state_nolock()) ffff9dab81e6d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790711926.975374:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+5:2406:x1877696867093888:12345-192.168.203.6@tcp:250:mount.lustre.0 Request processed in 353us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711926.975383:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 114 00000100:00100000:2.0:1790711926.994578:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711926.994721:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867094016 00000100:00100000:1.0:1790711926.994735:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867094016 00000100:00100000:1.0:1790711926.994810:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 115 00000100:00100000:1.0:1790711926.994823:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+5:18055:x1877696867094016:12345-192.168.203.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790711926.994850:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711926.994875:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab81dfaa00/0xcf3cf816241e0eb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa569 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711926.994934:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab81dfaa00/0xcf3cf816241e0eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa569 expref: 6 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711926.994948:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab81dfaa00/0xcf3cf816241e0eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa569 expref: 6 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711926.994959:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfaa00, rc 0) 00000100:00100000:1.0:1790711926.995048:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+6:18055:x1877696867094016:12345-192.168.203.6@tcp:101:mount.lustre.0 Request processed in 228us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711926.995056:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 115 00000100:00100000:1.0:1790711927.000731:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711927.002880:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867094144 00000100:00100000:3.0:1790711927.002901:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867094144 00000100:00100000:3.0:1790711927.002982:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 116 00000100:00100000:3.0:1790711927.003003:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+6:18055:x1877696867094144:12345-192.168.203.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790711927.005925:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+6:18055:x1877696867094144:12345-192.168.203.6@tcp:501:mount.lustre.0 Request processed in 2905us (5186us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790711927.005946:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 116 00000100:00100000:3.0:1790711927.022673:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711927.022723:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867094272 00000100:00100000:3.0:1790711927.022736:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867094272 00000100:00100000:3.0:1790711927.022799:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 117 00000100:00100000:3.0:1790711927.022812:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+6:18055:x1877696867094272:12345-192.168.203.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790711927.022835:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711927.022858:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacb5185a00/0xcf3cf816241e0eb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa570 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711927.022894:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacb5185a00/0xcf3cf816241e0eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa570 expref: 7 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711927.022906:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacb5185a00/0xcf3cf816241e0eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa570 expref: 7 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711927.022917:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacb5185a00, rc 0) 00000100:00100000:3.0:1790711927.022989:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc555050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+7:18055:x1877696867094272:12345-192.168.203.6@tcp:101:mount.lustre.0 Request processed in 179us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711927.022998:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 117 00000100:00100000:3.0:1790711927.026478:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711927.026525:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867094400 00000100:00100000:3.0:1790711927.026537:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867094400 00000100:00100000:3.0:1790711927.026609:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 118 00000100:00100000:3.0:1790711927.026626:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+7:18055:x1877696867094400:12345-192.168.203.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790711927.026818:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+8:18055:x1877696867094400:12345-192.168.203.6@tcp:501:mount.lustre.0 Request processed in 194us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711927.026826:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 118 00000100:00100000:0.0:1790711927.030517:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711927.031272:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867094528 00000100:00100000:3.0:1790711927.031287:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867094528 00000100:00100000:3.0:1790711927.031369:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 119 00000100:00100000:3.0:1790711927.031381:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+8:18055:x1877696867094528:12345-192.168.203.6@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790711927.031588:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+8:18055:x1877696867094528:12345-192.168.203.6@tcp:503:mount.lustre.0 Request processed in 209us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711927.031599:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 119 00000100:00100000:3.0:1790711927.043185:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711927.044902:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867094656 00000100:00100000:0.0:1790711927.044918:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867094656 00000100:00100000:0.0:1790711927.044987:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 120 00000100:00100000:0.0:1790711927.045000:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+8:18074:x1877696867094656:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790711927.045193:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+8:18074:x1877696867094656:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 195us (2030us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711927.045202:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 120 00000100:00100000:3.0:1790711927.080847:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711927.081020:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867094784 00000100:00100000:0.0:1790711927.081035:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867094784 00000100:00100000:0.0:1790711927.081111:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 121 00000100:00100000:0.0:1790711927.081122:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+8:18074:x1877696867094784:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790711927.082067:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+8:18074:x1877696867094784:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 939us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711927.082079:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 121 00000100:00100000:0.0:1790711927.085376:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711927.085468:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867094912 00000100:00100000:1.0:1790711927.085481:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867094912 00000100:00100000:1.0:1790711927.085580:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 122 00000100:00100000:1.0:1790711927.085592:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+8:18074:x1877696867094912:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790711927.085791:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+8:18074:x1877696867094912:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 201us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711927.085801:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 122 00000100:00100000:1.0:1790711927.089675:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711927.089736:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867095040 00000100:00100000:3.0:1790711927.089751:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867095040 00000100:00100000:2.0:1790711927.089891:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 123 00000100:00100000:2.0:1790711927.089919:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+8:18055:x1877696867095040:12345-192.168.203.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790711927.089944:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711927.089966:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab82d15600/0xcf3cf816241e0ebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa5a1 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711927.090002:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab82d15600/0xcf3cf816241e0ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5a1 expref: 9 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711927.090014:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab82d15600/0xcf3cf816241e0ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5a1 expref: 9 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711927.090025:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d15600, rc 0) 00000100:00100000:2.0:1790711927.090099:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+9:18055:x1877696867095040:12345-192.168.203.6@tcp:101:mount.lustre.0 Request processed in 181us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711927.090106:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 123 00000100:00100000:3.0:1790711927.094408:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711927.094592:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867095168 00000100:00100000:1.0:1790711927.094612:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867095168 00000100:00100000:1.0:1790711927.094770:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 124 00000100:00100000:1.0:1790711927.094783:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+9:18055:x1877696867095168:12345-192.168.203.6@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790711927.094820:0:22613:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790711927.094849:0:22613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790711927.094858:0:22613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790711927.094862:0:22613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790711927.094865:0:22613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1790711927.094868:0:22613:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1790711927.102507:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+9:18055:x1877696867095168:12345-192.168.203.6@tcp:256:mount.lustre.0 Request processed in 7709us (8097us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711927.102527:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 124 00000100:00100000:2.0:1790711927.106799:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711927.107773:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867095296 00000100:00100000:3.0:1790711927.107788:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867095296 00000100:00100000:3.0:1790711927.108441:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 125 00000100:00100000:3.0:1790711927.108453:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+9:18055:x1877696867095296:12345-192.168.203.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790711927.108476:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711927.108499:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacb5185800/0xcf3cf816241e0ec6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa5a8 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711927.108590:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacb5185800/0xcf3cf816241e0ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5a8 expref: 10 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711927.108603:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacb5185800/0xcf3cf816241e0ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5a8 expref: 10 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711927.108614:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacb5185800, rc 0) 00000100:00100000:3.0:1790711927.108684:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+10:18055:x1877696867095296:12345-192.168.203.6@tcp:101:mount.lustre.0 Request processed in 234us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711927.108692:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 125 00000100:00100000:0.0:1790711927.115125:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711927.115414:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867095424 00000100:00100000:3.0:1790711927.115427:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867095424 00000100:00100000:3.0:1790711927.115501:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 126 00000100:00100000:3.0:1790711927.115513:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+10:18055:x1877696867095424:12345-192.168.203.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790711927.115764:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+10:18055:x1877696867095424:12345-192.168.203.6@tcp:501:mount.lustre.0 Request processed in 252us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711927.115774:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 126 00000100:00100000:1.0:1790711927.121618:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711927.121759:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867095552 00000100:00100000:2.0:1790711927.122759:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867095552 00000100:00100000:2.0:1790711927.122846:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 127 00000100:00100000:2.0:1790711927.122859:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+10:18055:x1877696867095552:12345-192.168.203.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790711927.123112:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+10:18055:x1877696867095552:12345-192.168.203.6@tcp:503:mount.lustre.0 Request processed in 255us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711927.123120:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 127 00000100:00100000:2.0:1790711927.128693:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711927.128815:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867095680 00000100:00100000:1.0:1790711927.128829:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867095680 00000100:00100000:1.0:1790711927.128899:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 128 00000100:00100000:1.0:1790711927.128911:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+10:18079:x1877696867095680:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790711927.129129:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+10:18079:x1877696867095680:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 220us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711927.129139:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 128 00000100:00100000:0.0:1790711927.139224:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711927.139473:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867095808 00000100:00100000:3.0:1790711927.139487:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867095808 00000100:00100000:3.0:1790711927.139641:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 129 00000100:00100000:3.0:1790711927.139653:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+10:18079:x1877696867095808:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790711927.139936:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+10:18079:x1877696867095808:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 284us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711927.139945:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 129 00000100:00100000:1.0:1790711927.145012:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711927.145664:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867095936 00000100:00100000:3.0:1790711927.145693:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867095936 00000100:00100000:3.0:1790711927.145756:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:3.0:1790711927.145766:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1877696867095936:12345-192.168.203.6@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790711927.145804:0:22621:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6e97fa3d-af78-4872-a8a1-4a103992cb38@192.168.203.6@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1790711927.145867:0:22621:0:(genops.c:1384:class_connect()) connect: client 6e97fa3d-af78-4872-a8a1-4a103992cb38, cookie 0xcf3cf816241e0ecd 00000004:00100000:3.0:1790711927.145899:0:22621:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790711927.146278:0:22621:0:(import.c:65:import_set_state_nolock()) ffff9dab81e69800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790711927.146469:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:2406:x1877696867095936:12345-192.168.203.6@tcp:38:mount.lustre.0 Request processed in 701us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711927.146478:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:2.0:1790711927.156132:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711927.161701:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867096192 00000100:00100000:3.0:1790711927.161724:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867096192 00000100:00100000:3.0:1790711927.161785:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 8 00000100:00100000:3.0:1790711927.161795:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1877696867096192:12345-192.168.203.6@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790711927.161861:0:24457:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 6e97fa3d-af78-4872-a8a1-4a103992cb38@192.168.203.6@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1790711927.161929:0:24457:0:(genops.c:1384:class_connect()) connect: client 6e97fa3d-af78-4872-a8a1-4a103992cb38, cookie 0xcf3cf816241e0ed4 00000004:00100000:3.0:1790711927.161961:0:24457:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790711927.162246:0:24457:0:(import.c:65:import_set_state_nolock()) ffff9dacb71bb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790711927.162341:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:2406:x1877696867096192:12345-192.168.203.6@tcp:38:mount.lustre.0 Request processed in 545us (6223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711927.162351:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 8 00000100:00100000:2.0:1790711927.162732:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711927.162864:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711927.162902:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867096448 00000100:00100000:2.0:1790711927.162909:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867096448 00000100:00100000:2.0:1790711927.162957:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867096064 00000100:00100000:2.0:1790711927.162960:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867096064 00000100:00100000:2.0:1790711927.162980:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 9 00000100:00100000:2.0:1790711927.162988:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:18055:x1877696867096448:12345-192.168.203.6@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790711927.163022:0:22621:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790711927.163090:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:18055:x1877696867096448:12345-192.168.203.6@tcp:41:mount.lustre.0 Request processed in 98us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711927.163097:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 9 00000100:00100000:2.0:1790711927.163114:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 10 00000100:00100000:2.0:1790711927.163120:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:0:x1877696867096064:12345-192.168.203.6@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790711927.163132:0:22621:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790711927.163428:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:0:x1877696867096064:12345-192.168.203.6@tcp:41:mount.lustre.0 Request processed in 306us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711927.163437:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 10 00000100:00080000:2.0:1790711927.163460:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790711927.169030:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711927.169090:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711927.169210:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867096320 00000100:00100000:0.0:1790711927.169224:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867096320 00000100:00100000:0.0:1790711927.169315:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867096576 00000100:00100000:0.0:1790711927.169319:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867096576 00000100:00100000:0.0:1790711927.169349:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00080000:2.0:1790711927.169505:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790711927.169578:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:1.0:1790711927.169593:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18055:x1877696867096576:12345-192.168.203.6@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790711927.169717:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18055:x1877696867096576:12345-192.168.203.6@tcp:40:mount.lustre.0 Request processed in 128us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711927.169726:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:0.0:1790711927.170303:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:0:x1877696867096320:12345-192.168.203.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790711927.170335:0:24457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790711927.173893:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:0:x1877696867096320:12345-192.168.203.6@tcp:41:mount.lustre.0 Request processed in 3579us (4859us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711927.173935:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00100000:2.0:1790711927.184915:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711927.188483:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711927.188600:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711927.188754:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867096704 00000100:00100000:2.0:1790711927.188768:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867096704 00000100:00100000:2.0:1790711927.188823:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867096832 00000100:00100000:2.0:1790711927.188827:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867096832 00000100:00100000:2.0:1790711927.188847:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:2.0:1790711927.188858:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1877696867096704:12345-192.168.203.6@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790711927.188919:0:24127:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6e97fa3d-af78-4872-a8a1-4a103992cb38@192.168.203.6@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:2.0:1790711927.188964:0:24127:0:(genops.c:1384:class_connect()) connect: client 6e97fa3d-af78-4872-a8a1-4a103992cb38, cookie 0xcf3cf816241e0edb 00002000:00100000:2.0:1790711927.188981:0:24127:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e97fa3d-af78-4872-a8a1-4a103992cb38/ffff9dac8fd8a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790711927.189004:0:24127:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790711927.189252:0:24127:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790711927.189293:0:24127:0:(import.c:65:import_set_state_nolock()) ffff9dac8fd8d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790711927.189395:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:2406:x1877696867096704:12345-192.168.203.6@tcp:8:mount.lustre.0 Request processed in 536us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711927.189404:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:2.0:1790711927.189427:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:2.0:1790711927.189432:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1877696867096832:12345-192.168.203.6@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790711927.189449:0:24127:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6e97fa3d-af78-4872-a8a1-4a103992cb38@192.168.203.6@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:2.0:1790711927.189480:0:24127:0:(genops.c:1384:class_connect()) connect: client 6e97fa3d-af78-4872-a8a1-4a103992cb38, cookie 0xcf3cf816241e0ee2 00002000:00100000:2.0:1790711927.189487:0:24127:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e97fa3d-af78-4872-a8a1-4a103992cb38/ffff9dac8fd8c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790711927.189499:0:24127:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790711927.189650:0:24127:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790711927.189668:0:24127:0:(import.c:65:import_set_state_nolock()) ffff9dab82f13800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790711927.189707:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:2406:x1877696867096832:12345-192.168.203.6@tcp:8:mount.lustre.0 Request processed in 272us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711927.189714:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:0.0:1790711927.190465:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867096960 00000100:00100000:0.0:1790711927.190474:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867096960 00000100:00100000:0.0:1790711927.190552:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:0.0:1790711927.190563:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18055:x1877696867096960:12345-192.168.203.6@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790711927.190624:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18055:x1877696867096960:12345-192.168.203.6@tcp:900:mount.lustre.0 Request processed in 64us (5724us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711927.190632:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:2.0:1790711927.201944:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711927.202074:0:22624:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867097088 00000100:00100000:0.0:1790711927.202089:0:22624:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867097088 00000100:00100000:0.0:1790711927.202372:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 0 00000100:00100000:0.0:1790711927.202384:0:22624:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18055:x1877696867097088:12345-192.168.203.6@tcp:33:mount.lustre.0 00000004:00080000:2.0:1790711927.205297:0:22624:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2793us 00000004:00200000:0.0:1790711927.225144:0:22624:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790711927.225338:0:22624:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18055:x1877696867097088:12345-192.168.203.6@tcp:33:mount.lustre.0 Request processed in 22948us (23401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711927.225419:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 0 00000100:00100000:2.0:1790711927.484399:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711927.484791:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867097216 00000100:00100000:1.0:1790711927.484815:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867097216 00000100:00100000:1.0:1790711927.484894:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:1.0:1790711927.484907:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18102:x1877696867097216:12345-192.168.203.6@tcp:101:mkdir.0 00010000:00010000:1.0:1790711927.484938:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711927.484977:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e0ee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa5d9 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711927.485087:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e0ef0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711927.485106:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e0ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711927.485123:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e0ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790711927.485192:0:22623:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790711927.485196:0:22623:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790711927.485239:0:22623:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e0ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711927.485269:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e0ee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5d9 expref: 8 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711927.485289:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e0ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5d9 expref: 7 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711927.485299:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab83008f00) 00010000:00010000:1.0:1790711927.485302:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790711927.485307:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfa400, rc 0) 00000100:00100000:1.0:1790711927.488782:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:18102:x1877696867097216:12345-192.168.203.6@tcp:101:mkdir.0 Request processed in 3861us (4382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711927.488798:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 13 00010000:00010000:1.0:1790711927.902024:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711928.154994:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879800192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790711928.155147:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711928.155636:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879800320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790711928.155671:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711928.155760:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879800192 00000100:00100000:0.0:1790711928.155771:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879800192 00000100:00100000:0.0:1790711928.155839:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879800320 00000100:00100000:0.0:1790711928.155843:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879800320 00000100:00100000:0.0:1790711928.155864:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790711928.155876:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879800192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790711928.155907:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1790711928.155967:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879800192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711928.155976:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790711928.156010:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790711928.156017:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1877696879800320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790711928.156028:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1790711928.156059:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3610:x1877696879800320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711928.156066:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790711928.156214:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879800448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790711928.156249:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711928.156278:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879800448 00000100:00100000:2.0:1790711928.156282:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879800448 00000100:00100000:2.0:1790711928.156303:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790711928.156309:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879800448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790711928.156318:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790711928.156463:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879800448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711928.156471:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790711928.156523:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacb51b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879800448:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790711928.156613:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790711928.156618:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790711928.156741:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1877696879800832:0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.156777:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711928.156798:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879801344:0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.156819:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711928.156857:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879800320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790711928.156872:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1790711928.156878:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879800704:0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.156905:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711928.156928:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1877696879801216:0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.156950:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711928.156968:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1877696879801728:0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.156989:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711928.157024:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879800192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790711928.157048:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879800832 00000100:00100000:1.0:1790711928.157051:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879800832 00000100:00100000:1.0:1790711928.157075:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879801344 00000100:00100000:1.0:1790711928.157077:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879801344 00000100:00100000:1.0:1790711928.157094:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879801216 00000100:00100000:1.0:1790711928.157096:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879801216 00000100:00100000:1.0:1790711928.157104:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879801728 00000100:00100000:1.0:1790711928.157107:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879801728 00000100:00100000:1.0:1790711928.157133:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790711928.157139:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1877696879800832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.157180:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1877696879800832:12345-0@lo:400:kworker.0 Request processed in 40us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711928.157186:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790711928.157200:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790711928.157207:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1877696879801344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.157234:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1877696879801344:12345-0@lo:400:kworker.0 Request processed in 28us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711928.157239:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790711928.157251:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790711928.157257:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1877696879801216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.157282:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3610:x1877696879801216:12345-0@lo:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711928.157287:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790711928.157298:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790711928.157304:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1877696879801728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.157331:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3610:x1877696879801728:12345-0@lo:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711928.157337:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1790711928.157369:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790711928.157373:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790711928.157391:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3610:1877696879801216:0@lo:400:kworker.0 00010000:00080000:1.0:1790711928.157406:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83bb6300 x1877696879801728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790711928.157431:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3610:1877696879801728:0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.157447:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1877696879800832:0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.157456:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879801344:0@lo:400:kworker.0 00000100:00100000:3.0:1790711928.157721:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790711928.157754:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bc8ed208-5edc-469a-a5f9-449dbe325e20:3608:1877696879800576:0@lo:400:kworker.0 00000100:00100000:0.0:1790711928.157798:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711928.157823:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879801088:0@lo:400:kworker.0 00000100:00100000:0.0:1790711928.157851:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711928.157868:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879801600:0@lo:400:kworker.0 00000100:00100000:0.0:1790711928.157888:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711928.157909:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790711928.157914:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879800960:0@lo:400:kworker.0 00000100:00100000:0.0:1790711928.157937:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711928.157955:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1877696879801472:0@lo:400:kworker.0 00000100:00100000:0.0:1790711928.157980:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711928.158009:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879801600 00000100:00100000:0.0:1790711928.158014:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879801600 00000100:00100000:0.0:1790711928.158055:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879801472 00000100:00100000:0.0:1790711928.158059:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879801472 00000100:00100000:0.0:1790711928.158075:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790711928.158081:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1877696879801600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711928.158120:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1877696879801600:12345-0@lo:400:kworker.0 Request processed in 39us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711928.158126:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790711928.158152:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790711928.158158:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1877696879801472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711928.158189:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1877696879801472:12345-0@lo:400:kworker.0 Request processed in 31us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711928.158195:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790711928.158214:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879800704 00000100:00100000:0.0:1790711928.158218:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879800704 00000100:00100000:0.0:1790711928.158239:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879800960 00000100:00100000:0.0:1790711928.158242:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879800960 00000100:00100000:0.0:1790711928.158254:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790711928.158261:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879800704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711928.158294:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879800704:12345-0@lo:400:kworker.0 Request processed in 33us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711928.158299:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790711928.158310:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790711928.158316:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879800960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711928.158342:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879800960:12345-0@lo:400:kworker.0 Request processed in 26us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711928.158347:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1790711928.158388:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790711928.158392:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790711928.158413:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879800960:0@lo:400:kworker.0 00010000:00080000:0.0:1790711928.158424:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83bb4e00 x1877696879801472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711928.158434:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3608:1877696879801472:0@lo:400:kworker.0 00000100:00100000:0.0:1790711928.158444:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3608:1877696879801600:0@lo:400:kworker.0 00000100:00100000:2.0:1790711928.159507:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879801088 00000100:00100000:2.0:1790711928.159523:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879801088 00000100:00100000:2.0:1790711928.159637:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790711928.159648:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879801088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711928.159944:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879801088:12345-0@lo:400:kworker.0 Request processed in 298us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711928.159952:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790711928.160081:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879801088:0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.160664:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879800576 00000100:00100000:1.0:1790711928.160673:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879800576 00000100:00100000:1.0:1790711928.160865:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790711928.160877:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3608:x1877696879800576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711928.161729:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879801856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790711928.161795:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bc8ed208-5edc-469a-a5f9-449dbe325e20:3608:1877696879800576:0@lo:400:kworker.0 00000100:00100000:3.0:1790711928.161805:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711928.161858:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879801856 00000100:00100000:3.0:1790711928.161863:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879801856 00000100:00100000:3.0:1790711928.161919:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790711928.161927:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879801856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790711928.161952:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790711928.161996:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879801856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711928.162003:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790711928.162050:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879801856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790711928.162099:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879800704:0@lo:400:kworker.0 00000100:00100000:1.0:1790711928.164531:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3608:x1877696879800576:12345-0@lo:400:kworker.0 Request processed in 3642us (6717us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711928.165075:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1790711928.165170:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1790711928.681885:0:24946:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e97fa3d-af78-4872-a8a1-4a103992cb38 00000001:00080000:0.0:1790711928.681912:0:24946:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:3.0:1790711928.922761:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711929.178960:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879801984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790711929.179062:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711929.179319:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879802112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790711929.179365:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711929.179458:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879801984 00000100:00100000:3.0:1790711929.179469:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879801984 00000100:00100000:3.0:1790711929.179526:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879802112 00000100:00100000:3.0:1790711929.179529:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879802112 00000100:00100000:3.0:1790711929.179570:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790711929.179582:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879801984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790711929.179631:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790711929.179693:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879801984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.179701:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790711929.179724:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790711929.179731:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879802112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790711929.179749:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790711929.179780:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879802112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.179787:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790711929.179921:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879802112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790711929.180089:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879801984:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1790711929.371326:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790711929.545391:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711929.545631:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867097344 00000100:00100000:3.0:1790711929.545650:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867097344 00000100:00100000:3.0:1790711929.545747:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 14 00000100:00100000:3.0:1790711929.545771:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:18154:x1877696867097344:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1790711929.545816:0:24457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790711929.545954:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:18154:x1877696867097344:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 196us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.545962:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 14 00000100:00080000:0.0:1790711929.546417:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790711929.553338:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711929.553650:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867097472 00000100:00100000:3.0:1790711929.553663:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867097472 00000100:00100000:3.0:1790711929.553806:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 15 00000100:00100000:3.0:1790711929.553820:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18154:x1877696867097472:12345-192.168.203.6@tcp:41:lfs.0 00000004:00000024:3.0:1790711929.553865:0:22622:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790711929.553992:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18154:x1877696867097472:12345-192.168.203.6@tcp:41:lfs.0 Request processed in 175us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.554000:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 15 00000100:00080000:0.0:1790711929.554467:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790711929.562141:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711929.562224:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867097600 00000100:00100000:3.0:1790711929.562238:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867097600 00000100:00100000:3.0:1790711929.562336:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:3.0:1790711929.562357:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18154:x1877696867097600:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1790711929.562399:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1790711929.562514:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18154:x1877696867097600:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 160us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.562523:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00080000:0.0:1790711929.562870:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790711929.565701:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711929.565847:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867097728 00000100:00100000:3.0:1790711929.565860:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867097728 00000100:00100000:3.0:1790711929.565998:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 14 00000100:00100000:3.0:1790711929.566010:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:18154:x1877696867097728:12345-192.168.203.6@tcp:13:lfs.0 00002000:00000024:3.0:1790711929.566066:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790711929.566188:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:18154:x1877696867097728:12345-192.168.203.6@tcp:13:lfs.0 Request processed in 180us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.566196:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 14 00000100:00080000:0.0:1790711929.569049:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790711929.757989:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711929.769723:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867097856 00000100:00100000:3.0:1790711929.769744:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867097856 00000100:00100000:3.0:1790711929.769847:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 131 00000100:00100000:3.0:1790711929.769860:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+10:18184:x1877696867097856:12345-192.168.203.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790711929.769883:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711929.769909:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacb5184400/0xcf3cf816241e0ef7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa5e0 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711929.769944:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacb5184400/0xcf3cf816241e0ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5e0 expref: 11 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711929.769957:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacb5184400/0xcf3cf816241e0ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5e0 expref: 11 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711929.769967:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacb5184400, rc 0) 00000100:00100000:3.0:1790711929.770060:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18184:x1877696867097856:12345-192.168.203.6@tcp:101:mount.lustre.0 Request processed in 202us (12084us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.770067:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 131 00000100:00100000:2.0:1790711929.781819:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711929.782005:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867097984 00000100:00100000:1.0:1790711929.782018:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867097984 00000100:00100000:1.0:1790711929.782086:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 132 00000100:00100000:1.0:1790711929.782097:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18184:x1877696867097984:12345-192.168.203.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790711929.782963:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18184:x1877696867097984:12345-192.168.203.6@tcp:501:mount.lustre.0 Request processed in 240us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711929.782976:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 132 00000100:00100000:1.0:1790711929.789773:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711929.789935:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867098112 00000100:00100000:2.0:1790711929.789948:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867098112 00000100:00100000:2.0:1790711929.790020:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 133 00000100:00100000:2.0:1790711929.790031:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18184:x1877696867098112:12345-192.168.203.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790711929.790251:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18184:x1877696867098112:12345-192.168.203.6@tcp:503:mount.lustre.0 Request processed in 221us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711929.790260:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 133 00000100:00100000:3.0:1790711929.801027:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711929.801618:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867098240 00000100:00100000:1.0:1790711929.801647:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867098240 00000100:00100000:1.0:1790711929.801725:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 134 00000100:00100000:1.0:1790711929.801736:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18191:x1877696867098240:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790711929.801948:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18191:x1877696867098240:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 213us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711929.801958:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 134 00000100:00100000:3.0:1790711929.835815:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711929.836458:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867098368 00000100:00100000:1.0:1790711929.836472:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867098368 00000100:00100000:1.0:1790711929.836584:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 135 00000100:00100000:1.0:1790711929.836596:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18191:x1877696867098368:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790711929.836906:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18191:x1877696867098368:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 312us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711929.836918:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 135 00000100:00100000:2.0:1790711929.853245:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711929.854510:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867098496 00000100:00100000:0.0:1790711929.854530:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867098496 00000100:00100000:0.0:1790711929.854661:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 136 00000100:00100000:0.0:1790711929.854674:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18191:x1877696867098496:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790711929.854918:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18191:x1877696867098496:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 245us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711929.854926:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 136 00000100:00100000:3.0:1790711929.868061:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711929.868182:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867098624 00000100:00100000:1.0:1790711929.868195:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867098624 00000100:00100000:1.0:1790711929.868260:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 137 00000100:00100000:1.0:1790711929.868271:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18184:x1877696867098624:12345-192.168.203.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790711929.868292:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711929.868323:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab81dfb400/0xcf3cf816241e0efe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa611 expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711929.868512:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab81dfb400/0xcf3cf816241e0efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa611 expref: 12 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711929.868526:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab81dfb400/0xcf3cf816241e0efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa611 expref: 12 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711929.868593:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfb400, rc 0) 00000100:00100000:1.0:1790711929.868678:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:18184:x1877696867098624:12345-192.168.203.6@tcp:101:mount.lustre.0 Request processed in 408us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711929.868685:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 137 00000100:00100000:1.0:1790711929.894698:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711929.894992:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867098752 00000100:00100000:3.0:1790711929.895006:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867098752 00000100:00100000:3.0:1790711929.895103:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 138 00000100:00100000:3.0:1790711929.895114:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:18184:x1877696867098752:12345-192.168.203.6@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790711929.895148:0:22613:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790711929.895485:0:22613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790711929.895491:0:22613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790711929.895495:0:22613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790711929.895498:0:22613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790711929.895501:0:22613:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1790711929.905060:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:18184:x1877696867098752:12345-192.168.203.6@tcp:256:mount.lustre.0 Request processed in 9931us (10361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.905079:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 138 00000100:00100000:1.0:1790711929.909292:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711929.909980:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867098880 00000100:00100000:0.0:1790711929.909995:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867098880 00000100:00100000:0.0:1790711929.910071:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 139 00000100:00100000:0.0:1790711929.910082:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:18184:x1877696867098880:12345-192.168.203.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790711929.910104:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711929.910127:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa618 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711929.910235:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa618 expref: 13 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711929.910251:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa618 expref: 13 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711929.910279:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7200, rc 0) 00000100:00100000:0.0:1790711929.910731:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18184:x1877696867098880:12345-192.168.203.6@tcp:101:mount.lustre.0 Request processed in 649us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711929.910740:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 139 00000100:00100000:1.0:1790711929.915123:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711929.915259:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867099008 00000100:00100000:3.0:1790711929.915272:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867099008 00000100:00100000:3.0:1790711929.915364:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 140 00000100:00100000:3.0:1790711929.915376:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18184:x1877696867099008:12345-192.168.203.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790711929.915824:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18184:x1877696867099008:12345-192.168.203.6@tcp:501:mount.lustre.0 Request processed in 448us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.915835:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 140 00000100:00100000:2.0:1790711929.918255:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711929.918585:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867099136 00000100:00100000:0.0:1790711929.918598:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867099136 00000100:00100000:0.0:1790711929.918701:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 141 00000100:00100000:0.0:1790711929.918713:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18184:x1877696867099136:12345-192.168.203.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790711929.918903:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18184:x1877696867099136:12345-192.168.203.6@tcp:503:mount.lustre.0 Request processed in 192us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711929.918914:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 141 00000100:00100000:3.0:1790711929.921794:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711929.922123:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867099264 00000100:00100000:2.0:1790711929.922136:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867099264 00000100:00100000:2.0:1790711929.922208:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 142 00000100:00100000:2.0:1790711929.922219:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18199:x1877696867099264:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790711929.922685:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18199:x1877696867099264:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 466us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711929.922697:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 142 00000100:00100000:1.0:1790711929.925113:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711929.925266:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867099392 00000100:00100000:2.0:1790711929.925279:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867099392 00000100:00100000:2.0:1790711929.925826:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 143 00000100:00100000:2.0:1790711929.925840:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18199:x1877696867099392:12345-192.168.203.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790711929.926084:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18199:x1877696867099392:12345-192.168.203.6@tcp:502:llog_process_th.0 Request processed in 247us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711929.926103:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 143 00000100:00100000:1.0:1790711929.932496:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711929.932639:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711929.933235:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867099520 00000100:00100000:0.0:1790711929.933250:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867099520 00000100:00100000:1.0:1790711929.937064:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867099776 00000100:00100000:1.0:1790711929.937090:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867099776 00000100:00100000:3.0:1790711929.937100:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 16 00000100:00100000:3.0:1790711929.937120:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1877696867099520:12345-192.168.203.6@tcp:38:mount.lustre.0 00000100:00100000:1.0:1790711929.937158:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 17 00000100:00100000:1.0:1790711929.937165:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1877696867099776:12345-192.168.203.6@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790711929.937198:0:24457:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 201f8768-6771-4009-8040-f3ce7014ecea@192.168.203.6@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:3.0:1790711929.937250:0:24457:0:(genops.c:1384:class_connect()) connect: client 201f8768-6771-4009-8040-f3ce7014ecea, cookie 0xcf3cf816241e0f0c 00000004:00100000:3.0:1790711929.937287:0:24457:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1790711929.937790:0:24457:0:(import.c:65:import_set_state_nolock()) ffff9dacb71b8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790711929.939002:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+6:2406:x1877696867099520:12345-192.168.203.6@tcp:38:mount.lustre.0 Request processed in 1872us (6509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.939038:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 16 00010000:00080000:1.0:1790711929.941596:0:22623:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 201f8768-6771-4009-8040-f3ce7014ecea@192.168.203.6@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:1.0:1790711929.941652:0:22623:0:(genops.c:1384:class_connect()) connect: client 201f8768-6771-4009-8040-f3ce7014ecea, cookie 0xcf3cf816241e0f13 00000004:00100000:1.0:1790711929.941688:0:22623:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790711929.941818:0:22623:0:(import.c:65:import_set_state_nolock()) ffff9dacb49a8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790711929.941910:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:201f8768-6771-4009-8040-f3ce7014ecea+6:2406:x1877696867099776:12345-192.168.203.6@tcp:38:mount.lustre.0 Request processed in 4743us (9271us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711929.941921:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 17 00010000:00010000:1.0:1790711929.950510:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711929.955969:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711929.956017:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711929.956052:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711929.956159:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867100032 00000100:00100000:3.0:1790711929.956185:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867100032 00000100:00100000:3.0:1790711929.956267:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867099904 00000100:00100000:3.0:1790711929.956271:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867099904 00000100:00100000:3.0:1790711929.956318:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867099648 00000100:00100000:3.0:1790711929.956321:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867099648 00000100:00100000:3.0:1790711929.956350:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:3.0:1790711929.956361:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+7:18184:x1877696867100032:12345-192.168.203.6@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790711929.956419:0:24457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790711929.956508:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+7:18184:x1877696867100032:12345-192.168.203.6@tcp:41:mount.lustre.0 Request processed in 149us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.956517:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:3.0:1790711929.956537:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:3.0:1790711929.956576:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+6:0:x1877696867099904:12345-192.168.203.6@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790711929.956596:0:24457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790711929.956624:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+6:0:x1877696867099904:12345-192.168.203.6@tcp:41:mount.lustre.0 Request processed in 50us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.956630:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:3.0:1790711929.956643:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:3.0:1790711929.956649:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+6:0:x1877696867099648:12345-192.168.203.6@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790711929.956659:0:24457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790711929.956680:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+6:0:x1877696867099648:12345-192.168.203.6@tcp:41:mount.lustre.0 Request processed in 31us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.956685:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00080000:1.0:1790711929.957093:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790711929.957099:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790711929.976244:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711929.976453:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867100160 00000100:00100000:3.0:1790711929.976466:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867100160 00000100:00100000:3.0:1790711929.976576:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:3.0:1790711929.976589:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+6:18184:x1877696867100160:12345-192.168.203.6@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790711929.976695:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+6:18184:x1877696867100160:12345-192.168.203.6@tcp:40:mount.lustre.0 Request processed in 110us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711929.976703:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:3.0:1790711929.988114:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711929.988179:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711929.988402:0:25210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867100288 00000100:00100000:0.0:1790711929.988418:0:25210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867100288 00000100:00100000:0.0:1790711929.988477:0:25210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867100416 00000100:00100000:0.0:1790711929.988480:0:25210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867100416 00000100:00100000:0.0:1790711929.988514:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:0.0:1790711929.988525:0:25210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1877696867100288:12345-192.168.203.6@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790711929.988602:0:25210:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 201f8768-6771-4009-8040-f3ce7014ecea@192.168.203.6@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:0.0:1790711929.988651:0:25210:0:(genops.c:1384:class_connect()) connect: client 201f8768-6771-4009-8040-f3ce7014ecea, cookie 0xcf3cf816241e0f1a 00002000:00100000:0.0:1790711929.988670:0:25210:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 201f8768-6771-4009-8040-f3ce7014ecea/ffff9dab81dce800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790711929.988686:0:25210:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790711929.988784:0:25210:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790711929.988842:0:25210:0:(import.c:65:import_set_state_nolock()) ffff9dab81dcd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790711929.988933:0:25210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:201f8768-6771-4009-8040-f3ce7014ecea+6:2406:x1877696867100288:12345-192.168.203.6@tcp:8:mount.lustre.0 Request processed in 408us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711929.988943:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:0.0:1790711929.988967:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:0.0:1790711929.988972:0:25210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1877696867100416:12345-192.168.203.6@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790711929.988991:0:25210:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 201f8768-6771-4009-8040-f3ce7014ecea@192.168.203.6@tcp t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:0.0:1790711929.989011:0:25210:0:(genops.c:1384:class_connect()) connect: client 201f8768-6771-4009-8040-f3ce7014ecea, cookie 0xcf3cf816241e0f21 00002000:00100000:0.0:1790711929.989017:0:25210:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 201f8768-6771-4009-8040-f3ce7014ecea/ffff9dab81dce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790711929.989025:0:25210:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790711929.989080:0:25210:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790711929.989095:0:25210:0:(import.c:65:import_set_state_nolock()) ffff9dab81dcc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790711929.989120:0:25210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:201f8768-6771-4009-8040-f3ce7014ecea+6:2406:x1877696867100416:12345-192.168.203.6@tcp:8:mount.lustre.0 Request processed in 146us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711929.989128:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:1.0:1790711929.993021:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711929.993164:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867100544 00000100:00100000:0.0:1790711929.993193:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867100544 00000100:00100000:0.0:1790711929.993305:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:0.0:1790711929.993318:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:201f8768-6771-4009-8040-f3ce7014ecea+6:18184:x1877696867100544:12345-192.168.203.6@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790711929.993439:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:201f8768-6771-4009-8040-f3ce7014ecea+6:18184:x1877696867100544:12345-192.168.203.6@tcp:900:mount.lustre.0 Request processed in 123us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711929.993448:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:2.0:1790711930.003168:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711930.003281:0:22625:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867100672 00000100:00100000:3.0:1790711930.003309:0:22625:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867100672 00000100:00100000:3.0:1790711930.003386:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 1 00000100:00100000:3.0:1790711930.003398:0:22625:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:201f8768-6771-4009-8040-f3ce7014ecea+6:18184:x1877696867100672:12345-192.168.203.6@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790711930.003521:0:22625:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790711930.003661:0:22625:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:201f8768-6771-4009-8040-f3ce7014ecea+6:18184:x1877696867100672:12345-192.168.203.6@tcp:33:mount.lustre.0 Request processed in 265us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711930.003670:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 1 00000100:00100000:3.0:1790711930.168901:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711930.169017:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867100800 00000100:00100000:0.0:1790711930.169030:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867100800 00000100:00100000:0.0:1790711930.169103:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:0.0:1790711930.169115:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:201f8768-6771-4009-8040-f3ce7014ecea+6:18222:x1877696867100800:12345-192.168.203.6@tcp:101:mkdir.0 00010000:00010000:0.0:1790711930.169152:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711930.169182:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa649 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711930.169271:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711930.169290:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711930.169320:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790711930.169392:0:22623:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790711930.169397:0:22623:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790711930.169437:0:22623:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711930.169469:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa649 expref: 8 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711930.169492:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa649 expref: 7 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711930.169503:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab83008f00) 00010000:00010000:0.0:1790711930.169506:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790711930.169510:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef6000, rc 0) 00000100:00100000:0.0:1790711930.169660:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:201f8768-6771-4009-8040-f3ce7014ecea+7:18222:x1877696867100800:12345-192.168.203.6@tcp:101:mkdir.0 Request processed in 546us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711930.169669:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 22 00010000:00010000:1.0:1790711930.971479:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790711931.994740:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790711932.765846:0:24124:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 201f8768-6771-4009-8040-f3ce7014ecea 00000001:00100000:2.0:1790711932.765867:0:24124:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e97fa3d-af78-4872-a8a1-4a103992cb38 00000001:00100000:2.0:1790711932.778816:0:22601:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 201f8768-6771-4009-8040-f3ce7014ecea 00000001:00100000:2.0:1790711932.778834:0:22601:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e97fa3d-af78-4872-a8a1-4a103992cb38 00000001:00100000:2.0:1790711932.779150:0:23355:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 201f8768-6771-4009-8040-f3ce7014ecea 00000001:00100000:2.0:1790711932.779161:0:23355:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e97fa3d-af78-4872-a8a1-4a103992cb38 00010000:00010000:0.0:1790711933.021649:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711933.275417:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879802240:0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.275523:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711933.275604:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1877696879802752:0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.275636:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711933.275659:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1877696879803264:0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.275680:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711933.275700:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbfba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1877696879803776:0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.275747:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711933.275756:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879802240 00000100:00100000:0.0:1790711933.275769:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879802240 00000100:00100000:3.0:1790711933.275782:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1790711933.275791:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879802368:0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.275822:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711933.275831:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790711933.275844:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3609:x1877696879802240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.275846:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879802880:0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.275873:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711933.275896:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbfba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1877696879803392:0@lo:400:kworker.0 00000100:00100000:0.0:1790711933.275917:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3609:x1877696879802240:12345-0@lo:400:kworker.0 Request processed in 74us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711933.275927:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790711933.275941:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711933.275966:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879803904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790711933.275972:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879802752 00000100:00100000:0.0:1790711933.275976:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879802752 00000100:00100000:3.0:1790711933.276001:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711933.276003:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879803264 00000100:00100000:0.0:1790711933.276007:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879803264 00000100:00100000:0.0:1790711933.276024:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879803776 00000100:00100000:0.0:1790711933.276026:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879803776 00000100:00100000:3.0:1790711933.276043:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879802240:0@lo:400:kworker.0 00000100:00100000:0.0:1790711933.276074:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879803392 00000100:00100000:0.0:1790711933.276078:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879803392 00000100:00100000:3.0:1790711933.276096:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790711933.276105:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1877696879802752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.276151:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1877696879802752:12345-0@lo:400:kworker.0 Request processed in 47us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711933.276259:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879802496:0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.276320:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711933.276343:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879803008:0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.276361:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711933.276376:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbfba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1877696879803520:0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.276392:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711933.276400:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879804032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790711933.276413:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711933.276429:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1790711933.276436:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879802624:0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.276453:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711933.276468:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879803136:0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.276486:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711933.276500:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbfba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1877696879803648:0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.276532:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711933.276555:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879804160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790711933.276572:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711933.276621:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879802496 00000100:00100000:2.0:1790711933.276625:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879802496 00000100:00100000:2.0:1790711933.276647:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879803008 00000100:00100000:2.0:1790711933.276650:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879803008 00000100:00100000:2.0:1790711933.276660:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879802624 00000100:00100000:2.0:1790711933.276662:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879802624 00000100:00100000:2.0:1790711933.276673:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879803136 00000100:00100000:2.0:1790711933.276674:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879803136 00000100:00100000:2.0:1790711933.276688:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790711933.276694:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879802496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.276728:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879802496:12345-0@lo:400:kworker.0 Request processed in 34us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711933.276733:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790711933.276746:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790711933.276751:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879803008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.276772:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879803008:12345-0@lo:400:kworker.0 Request processed in 21us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711933.276778:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790711933.276787:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790711933.276792:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879802624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.276831:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879802624:12345-0@lo:400:kworker.0 Request processed in 38us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711933.276836:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790711933.276846:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790711933.276857:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879803136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.276884:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879803136:12345-0@lo:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711933.276889:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790711933.276905:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879803904 00000100:00100000:2.0:1790711933.276909:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879803904 00000100:00100000:2.0:1790711933.276920:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879804032 00000100:00100000:2.0:1790711933.276922:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879804032 00000100:00100000:2.0:1790711933.276928:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879804160 00000100:00100000:2.0:1790711933.276930:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879804160 00000100:00100000:2.0:1790711933.276938:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790711933.276943:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879803904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790711933.276966:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790711933.277000:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879803904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711933.277006:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790711933.277015:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790711933.277020:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879804032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790711933.277034:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790711933.277053:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879804032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711933.277058:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790711933.277066:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790711933.277070:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879804160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790711933.277077:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1790711933.277095:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879804160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711933.277111:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790711933.277139:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790711933.277149:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab82f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879804288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790711933.277178:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711933.277203:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879804288 00000100:00100000:2.0:1790711933.277206:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879804288 00000100:00100000:2.0:1790711933.277224:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790711933.277231:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879804288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790711933.277242:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1790711933.277274:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879804288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711933.277280:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790711933.277335:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab82f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879804288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790711933.277362:0:3607:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1790711933.277373:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879802624:0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.277383:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879803136:0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.277395:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879804160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790711933.277404:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879802496:0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.277414:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879803008:0@lo:400:kworker.0 00000100:00100000:2.0:1790711933.277426:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879804032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790711933.280288:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790711933.280841:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1877696879803264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711933.280977:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1877696879803264:12345-0@lo:400:kworker.0 Request processed in 672us (5294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711933.280987:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790711933.281028:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879803520 00000100:00100000:0.0:1790711933.281047:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879803520 00000100:00100000:0.0:1790711933.281088:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879803648 00000100:00100000:0.0:1790711933.281092:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879803648 00000100:00100000:0.0:1790711933.281113:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790711933.281120:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1877696879803776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711933.281156:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1877696879803776:12345-0@lo:400:kworker.0 Request processed in 36us (5409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711933.281195:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790711933.281209:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790711933.281216:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1877696879803392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711933.281252:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1877696879803392:12345-0@lo:400:kworker.0 Request processed in 37us (5312us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711933.281258:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790711933.281269:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790711933.281276:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877696879803520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711933.281334:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877696879803520:12345-0@lo:400:kworker.0 Request processed in 59us (4940us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711933.281340:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790711933.281351:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790711933.281358:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877696879803648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711933.281387:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877696879803648:12345-0@lo:400:kworker.0 Request processed in 30us (4855us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711933.281393:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1790711933.281413:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790711933.281419:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790711933.281423:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790711933.281425:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790711933.283758:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbfba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1877696879803648:0@lo:400:kworker.0 00010000:00080000:2.0:1790711933.283787:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dacbfba7480 x1877696879803520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790711933.283820:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbfba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3607:1877696879803520:0@lo:400:kworker.0 00000100:00100000:0.0:1790711933.286269:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879802368 00000100:00100000:0.0:1790711933.286290:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879802368 00000100:00100000:0.0:1790711933.286509:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879802880 00000100:00100000:0.0:1790711933.286514:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879802880 00000100:00100000:0.0:1790711933.286559:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790711933.286571:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879802368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711933.286720:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879802368:12345-0@lo:400:kworker.0 Request processed in 151us (10897us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711933.286728:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790711933.286751:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790711933.286757:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879802880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790711933.286789:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879802880:12345-0@lo:400:kworker.0 Request processed in 32us (10914us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711933.286794:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790711933.286856:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790711933.287033:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879802368:0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.287049:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879802880:0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.287066:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbfba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3609:1877696879803392:0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.287089:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879803904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790711933.287102:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3609:1877696879802752:0@lo:400:kworker.0 00000100:00100000:3.0:1790711933.287115:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3609:1877696879803264:0@lo:400:kworker.0 00010000:00080000:3.0:1790711933.287141:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dacbfba4700 x1877696879803776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711933.287151:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbfba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3609:1877696879803776:0@lo:400:kworker.0 00000001:02000400:1.0:1790711933.557152:0:25503:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1790711934.042794:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790711934.110039:0:23375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790711934.298861:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790711934.298862:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790711934.298892:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879804416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790711934.298899:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879804544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790711934.303732:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711934.308463:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879804416 00000100:00100000:1.0:1790711934.308492:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879804416 00000100:00100000:0.0:1790711934.309420:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711934.309711:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879804544 00000100:00100000:1.0:1790711934.309721:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879804544 00000100:00100000:1.0:1790711934.309756:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790711934.309766:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879804416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790711934.309819:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790711934.309892:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879804416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (6302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711934.309900:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790711934.309923:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790711934.309928:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879804544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790711934.309948:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790711934.312532:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879804544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790711934.312672:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879804416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790711934.313248:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879804544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3314us (3831us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711934.313268:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:0.0:1790711935.066741:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711935.103708:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711935.103752:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711935.103777:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711935.103813:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711935.103832:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711935.103849:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711935.103892:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711935.103908:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711935.103929:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711935.104007:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867100928 00000100:00100000:2.0:1790711935.104019:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867100928 00000100:00100000:2.0:1790711935.104085:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 145 00000100:00100000:2.0:1790711935.104095:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:2407:x1877696867100928:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1790711935.104169:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:2407:x1877696867100928:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 76us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711935.104177:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 145 00000100:00100000:2.0:1790711935.104210:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867101184 00000100:00100000:2.0:1790711935.104213:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867101184 00000100:00100000:2.0:1790711935.104242:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867101696 00000100:00100000:2.0:1790711935.104244:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867101696 00000100:00100000:2.0:1790711935.104254:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867101056 00000100:00100000:2.0:1790711935.104256:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867101056 00000100:00100000:2.0:1790711935.104267:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867101568 00000100:00100000:2.0:1790711935.104269:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867101568 00000100:00100000:2.0:1790711935.104282:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 46 00000100:00100000:2.0:1790711935.104287:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867101184:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1790711935.104334:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867101184:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 46us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711935.104340:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 46 00000100:00100000:2.0:1790711935.104353:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 47 00000100:00100000:2.0:1790711935.104360:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:201f8768-6771-4009-8040-f3ce7014ecea+5:2407:x1877696867101696:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1790711935.104384:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:201f8768-6771-4009-8040-f3ce7014ecea+5:2407:x1877696867101696:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 25us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711935.104397:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 47 00000100:00100000:2.0:1790711935.104410:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 48 00000100:00100000:2.0:1790711935.104416:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:2407:x1877696867101056:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1790711935.104441:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:2407:x1877696867101056:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 26us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711935.104447:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 48 00000100:00100000:2.0:1790711935.104457:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 49 00000100:00100000:2.0:1790711935.104462:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:201f8768-6771-4009-8040-f3ce7014ecea+6:2407:x1877696867101568:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1790711935.104483:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:201f8768-6771-4009-8040-f3ce7014ecea+6:2407:x1877696867101568:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 21us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711935.104488:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 49 00000100:00100000:2.0:1790711935.104506:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867101440 00000100:00100000:2.0:1790711935.104509:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867101440 00000100:00100000:2.0:1790711935.104531:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867101952 00000100:00100000:2.0:1790711935.104533:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867101952 00000100:00100000:2.0:1790711935.104587:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867101312 00000100:00100000:2.0:1790711935.104590:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867101312 00000100:00100000:2.0:1790711935.104601:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867101824 00000100:00100000:2.0:1790711935.104604:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867101824 00000100:00100000:2.0:1790711935.104616:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 10 00000100:00100000:2.0:1790711935.104621:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867101440:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1790711935.104647:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867101440:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 25us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711935.104654:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 10 00000100:00100000:2.0:1790711935.104665:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00100000:2.0:1790711935.104677:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:201f8768-6771-4009-8040-f3ce7014ecea+6:2407:x1877696867101952:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1790711935.104702:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:201f8768-6771-4009-8040-f3ce7014ecea+6:2407:x1877696867101952:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 25us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711935.104708:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00100000:2.0:1790711935.104719:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:2.0:1790711935.104725:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867101312:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1790711935.104748:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867101312:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 24us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711935.104754:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:2.0:1790711935.104764:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:2.0:1790711935.104769:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:201f8768-6771-4009-8040-f3ce7014ecea+5:2407:x1877696867101824:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1790711935.104787:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:201f8768-6771-4009-8040-f3ce7014ecea+5:2407:x1877696867101824:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 19us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711935.104793:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00080000:2.0:1790711935.104945:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790711935.104949:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790711935.104952:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790711935.104954:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1790711935.836910:0:24946:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 201f8768-6771-4009-8040-f3ce7014ecea 00010000:00010000:3.0:1790711936.097239:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711937.120014:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790711938.110955:0:25651:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb2644e40 20000000:00000080:2.0:1790711938.110980:0:25651:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9dacae90d800 uarg=0000000000000000 20000000:01000000:2.0:1790711938.111037:0:25651:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790711938.111044:0:25651:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790711938.111050:0:25651:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790711938.112252:0:25652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1790711938.112779:0:25651:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790711938.125817:0:25651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790711938.125923:0:25651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.125965:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dac8167ce00/0xcf3cf816241e0b93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b8c expref: 23 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.125974:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dac8167d400/0xcf3cf816241e0ba1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0b9a expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.125982:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dac8167d600/0xcf3cf816241e0be0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0bd9 expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.125989:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dab82d14400/0xcf3cf816241e0d61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0d5a expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.126002:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dacb5185800/0xcf3cf816241e0ec6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5a8 expref: 12 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.126009:0:25651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa618 expref: 12 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.126018:0:25651:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.126072:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa618 expref: 12 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.126090:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa618 expref: 12 pid: 22614 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711938.126109:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab82f41f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879804672:192.168.203.6@tcp:104: 00010000:00010000:2.0:1790711938.126254:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dacb5185800/0xcf3cf816241e0ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5a8 expref: 12 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.126267:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dacb5185800/0xcf3cf816241e0ec6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5a8 expref: 12 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711938.126635:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab82f43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879804800:192.168.203.6@tcp:104: 00010000:00010000:2.0:1790711938.126690:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dab82d14400/0xcf3cf816241e0d61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0d5a expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.126699:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dab82d14400/0xcf3cf816241e0d61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0d5a expref: 23 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711938.126708:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab82f42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879804928:0@lo:104: 00000100:00100000:2.0:1790711938.126819:0:25651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790711938.126856:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dac8167d600/0xcf3cf816241e0be0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0bd9 expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.126865:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dac8167d600/0xcf3cf816241e0be0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0bd9 expref: 23 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711938.126873:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab82f40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879805056:0@lo:104: 00000100:00100000:2.0:1790711938.126890:0:25651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711938.126920:0:22605:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879804928 00000100:00100000:2.0:1790711938.126929:0:22605:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879804928 00000100:00100000:2.0:1790711938.126970:0:22605:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879805056 00000100:00100000:2.0:1790711938.126972:0:22605:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879805056 00000100:00100000:2.0:1790711938.126984:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790711938.126993:0:22605:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+4:25651:x1877696879804928:12345-0@lo:104: 00010000:00010000:2.0:1790711938.127008:0:22605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.127065:0:22605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790711938.127071:0:22605:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+4:25651:x1877696879804928:12345-0@lo:104: Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711938.127078:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790711938.127096:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790711938.127101:0:22605:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:25651:x1877696879805056:12345-0@lo:104: 00010000:00010000:2.0:1790711938.127108:0:22605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.127136:0:22605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790711938.127140:0:22605:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:25651:x1877696879805056:12345-0@lo:104: Request processed in 39us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711938.127146:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1790711938.127170:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dac8167d400/0xcf3cf816241e0ba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0b9a expref: 23 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.127178:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dac8167d400/0xcf3cf816241e0ba1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0b9a expref: 23 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711938.127186:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879805184:0@lo:104: 00000100:00100000:2.0:1790711938.127204:0:25651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711938.127219:0:22605:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879805184 00000100:00100000:2.0:1790711938.127222:0:22605:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879805184 00000100:00100000:2.0:1790711938.127235:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790711938.127240:0:22605:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:25651:x1877696879805184:12345-0@lo:104: 00010000:00010000:2.0:1790711938.127246:0:22605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.127294:0:22605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790711938.127299:0:22605:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:25651:x1877696879805184:12345-0@lo:104: Request processed in 59us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711938.127305:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1790711938.127507:0:25651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9dac8167ce00/0xcf3cf816241e0b93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3cf816241e0b8c expref: 23 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.127516:0:25651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9dac8167ce00/0xcf3cf816241e0b93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3cf816241e0b8c expref: 23 pid: 22613 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711938.127524:0:25651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879805312:0@lo:104: 00000100:00100000:2.0:1790711938.127573:0:25651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711938.127600:0:25651:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca09313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790711938.127624:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab82f42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879804928:0@lo:104: 00000100:00100000:2.0:1790711938.127632:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab82f40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879805056:0@lo:104: 00000100:00100000:2.0:1790711938.127638:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879805184:0@lo:104: 00010000:00010000:0.0:1790711938.128022:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790711938.128031:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128040:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacbcb74200 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711938.128046:0:22609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128057:0:22609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711938.128079:0:22609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711938.128085:0:22609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790711938.128121:0:22609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128127:0:22609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711938.128148:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128156:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dacbcb74200/0xcf3cf816241e0d5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0d61 expref: -99 pid: 24945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128170:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790711938.128173:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128178:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167dc00 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711938.128182:0:22609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128189:0:22609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711938.128195:0:22609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711938.128200:0:22609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790711938.128216:0:22609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128222:0:22609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711938.128236:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128243:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dac8167dc00/0xcf3cf816241e0bd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0be0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128253:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790711938.128256:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128261:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d14200 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711938.128264:0:22609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128271:0:22609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711938.128290:0:22609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711938.128295:0:22609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790711938.128306:0:22609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128312:0:22609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711938.128325:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128342:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dab82d14200/0xcf3cf816241e0b9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0ba1 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128352:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711938.128353:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711938.128355:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711938.128371:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bc8ed208-5edc-469a-a5f9-449dbe325e20:3608:1877696879805440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711938.128415:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711938.128603:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879805568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711938.128626:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711938.128642:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790711938.128647:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879805696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711938.128663:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711938.128690:0:22607:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879805440 00000100:00100000:0.0:1790711938.128696:0:22607:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879805440 00010000:00010000:0.0:1790711938.128735:0:22607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dab82d14400/0xcf3cf816241e0d61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0d5a expref: 24 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711938.128758:0:22607:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879805568 00000100:00100000:0.0:1790711938.128760:0:22607:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879805568 00010000:00010000:0.0:1790711938.128771:0:22607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dac8167d600/0xcf3cf816241e0be0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0bd9 expref: 25 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711938.128779:0:22607:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879805696 00000100:00100000:0.0:1790711938.128781:0:22607:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879805696 00010000:00010000:0.0:1790711938.128788:0:22607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dac8167d400/0xcf3cf816241e0ba1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b9a expref: 26 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711938.128813:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790711938.128820:0:22607:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+26:3608:x1877696879805440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790711938.128833:0:22607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711938.128839:0:22607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dab82d14400/0xcf3cf816241e0d61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0d5a expref: 26 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128849:0:22607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dab82d14400/0xcf3cf816241e0d61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0d5a expref: 26 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128864:0:22607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d14400/0xcf3cf816241e0d61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0d5a expref: 26 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128877:0:22607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790711938.128907:0:22607:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+25:3608:x1877696879805440:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711938.128915:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790711938.128931:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790711938.128936:0:22607:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3609:x1877696879805568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790711938.128943:0:22607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711938.128947:0:22607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dac8167d600/0xcf3cf816241e0be0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0bd9 expref: 24 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128955:0:22607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dac8167d600/0xcf3cf816241e0be0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0bd9 expref: 24 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128965:0:22607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac8167d600/0xcf3cf816241e0be0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0bd9 expref: 24 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.128983:0:22607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790711938.129004:0:22607:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:3609:x1877696879805568:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711938.129010:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790711938.129021:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790711938.129026:0:22607:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:3609:x1877696879805696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790711938.129034:0:22607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711938.129038:0:22607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dac8167d400/0xcf3cf816241e0ba1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b9a expref: 22 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.129047:0:22607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dac8167d400/0xcf3cf816241e0ba1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0b9a expref: 22 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.129059:0:22607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac8167d400/0xcf3cf816241e0ba1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0b9a expref: 22 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711938.129062:0:22605:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879805312 00000100:00100000:1.0:1790711938.129069:0:22605:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879805312 00010000:00010000:0.0:1790711938.129071:0:22607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790711938.129092:0:22607:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:3609:x1877696879805696:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711938.129099:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790711938.129105:0:22605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790711938.129127:0:22605:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83989500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:25651:x1877696879805312:12345-0@lo:104: 00010000:00010000:1.0:1790711938.129141:0:22605:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711938.129144:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bc8ed208-5edc-469a-a5f9-449dbe325e20:3608:1877696879805440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711938.129175:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879805696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711938.129186:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879805568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790711938.129216:0:22605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790711938.129224:0:22605:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83989500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+3:25651:x1877696879805312:12345-0@lo:104: Request processed in 100us (1649us total) trans 0 rc 0/0 00010000:00010000:0.0:1790711938.129228:0:22609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1790711938.129233:0:22605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1790711938.129235:0:22609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.129250:0:22609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d13000 already unused, calling callback (ffffffffc122bc20) 10000000:00010000:0.0:1790711938.129254:0:22609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.129264:0:22609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790711938.129271:0:22609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790711938.129287:0:22609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790711938.129309:0:22609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.129324:0:22609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790711938.129348:0:22609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.129355:0:22609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.106@tcp lock: ffff9dab82d13000/0xcf3cf816241e0b8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3cf816241e0b93 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.129372:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711938.129374:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790711938.129376:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711938.129382:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790711938.129397:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bc8ed208-5edc-469a-a5f9-449dbe325e20:3608:1877696879805824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790711938.129629:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711938.129656:0:22607:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879805824 00000100:00100000:0.0:1790711938.129660:0:22607:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879805824 00010000:00010000:0.0:1790711938.129680:0:22607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dac8167ce00/0xcf3cf816241e0b93 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b8c expref: 21 pid: 22613 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711938.129697:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790711938.129702:0:22607:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:3608:x1877696879805824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790711938.129709:0:22607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711938.129808:0:22607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dac8167ce00/0xcf3cf816241e0b93 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3cf816241e0b8c expref: 21 pid: 22613 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.129820:0:22607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dac8167ce00/0xcf3cf816241e0b93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3cf816241e0b8c expref: 21 pid: 22613 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711938.129832:0:22607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790711938.129905:0:22607:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:3608:x1877696879805824:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711938.129913:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1790711938.130060:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790711938.130124:0:25651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac8167ce00/0xcf3cf816241e0b93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3cf816241e0b8c expref: 20 pid: 22613 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711938.130139:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879805312:0@lo:104: 00000100:00100000:1.0:1790711938.130184:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bc8ed208-5edc-469a-a5f9-449dbe325e20:3608:1877696879805824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790711938.131472:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711938.131627:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab82f41f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879804672:192.168.203.6@tcp:104: 00000100:00100000:1.0:1790711938.131892:0:22606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867102080 00000100:00100000:1.0:1790711938.131903:0:22606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867102080 00010000:00010000:1.0:1790711938.131955:0:22606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa618 expref: 13 pid: 22614 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711938.132036:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:1.0:1790711938.132048:0:22606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacafdc9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:2407:x1877696867102080:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790711938.132067:0:22606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790711938.132074:0:22606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa618 expref: 13 pid: 22614 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.132089:0:22606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa618 expref: 13 pid: 22614 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.132120:0:22606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa618 expref: 13 pid: 22614 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.132136:0:22606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790711938.132206:0:22606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacafdc9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:2407:x1877696867102080:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 160us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711938.132215:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:3.0:1790711938.136024:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711938.136072:0:25651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab82f43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25651:1877696879804800:192.168.203.6@tcp:104: 00010000:00010000:0.0:1790711938.136132:0:25651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711938.137319:0:22607:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867102208 00000100:00100000:1.0:1790711938.137337:0:22607:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867102208 00010000:00010000:1.0:1790711938.137397:0:22607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9dacb5185800/0xcf3cf816241e0ec6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5a8 expref: 12 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711938.137463:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 14 00000100:00100000:1.0:1790711938.137474:0:22607:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:2408:x1877696867102208:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790711938.137504:0:22607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790711938.137511:0:22607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9dacb5185800/0xcf3cf816241e0ec6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5a8 expref: 12 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137525:0:22607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9dacb5185800/0xcf3cf816241e0ec6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5a8 expref: 12 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137573:0:22607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dacb5185800/0xcf3cf816241e0ec6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5a8 expref: 12 pid: 22615 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137608:0:22607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137619:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137656:0:22607:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137663:0:22607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137669:0:22607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137676:0:22607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137683:0:22607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d14a00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:1.0:1790711938.137688:0:22607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137698:0:22607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137718:0:22607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711938.137729:0:22607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790711938.137805:0:22607:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:2408:x1877696867102208:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 333us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711938.137814:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 14 00010000:00010000:2.0:1790711938.138044:0:25651:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.138055:0:25651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.138075:0:25651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9dab82d14a00/0xcf3cf816241e0f36 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711938.146724:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711938.401174:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879805952:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401271:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.401332:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879806464:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401358:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.401380:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1877696879806976:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401406:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.401437:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1790711938.401444:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1877696879806336:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401466:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.401484:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879806848:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401504:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.401521:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8391e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879807360:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401566:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.401599:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879806080:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401627:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.401660:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879806592:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401683:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.401714:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879807104:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401736:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.401750:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1790711938.401755:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879806208:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401775:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.401790:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879806720:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401809:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.401825:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1877696879807232:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.401984:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.402019:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879805952 00000100:00100000:3.0:1790711938.402029:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879805952 00000100:00100000:3.0:1790711938.402084:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879806464 00000100:00100000:3.0:1790711938.402087:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879806464 00000100:00100000:3.0:1790711938.402107:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790711938.402117:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879805952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.402186:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879805952:12345-0@lo:400:kworker.0 Request processed in 69us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711938.402194:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790711938.402215:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790711938.402221:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879806464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.402250:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879806464:12345-0@lo:400:kworker.0 Request processed in 30us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711938.402256:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790711938.402290:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879806976 00000100:00100000:3.0:1790711938.402301:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879806976 00000100:00100000:3.0:1790711938.403998:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879806336 00000100:00100000:3.0:1790711938.404006:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879806336 00000100:00100000:3.0:1790711938.404020:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879806848 00000100:00100000:3.0:1790711938.404023:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879806848 00000100:00100000:3.0:1790711938.404033:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879807360 00000100:00100000:3.0:1790711938.404036:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879807360 00000100:00100000:3.0:1790711938.404051:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879807104 00000100:00100000:3.0:1790711938.404053:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879807104 00000100:00100000:3.0:1790711938.404068:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879807232 00000100:00100000:3.0:1790711938.404071:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879807232 00000100:00100000:3.0:1790711938.404116:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790711938.404127:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1877696879806976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.404225:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1877696879806976:12345-0@lo:400:kworker.0 Request processed in 100us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711938.404232:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790711938.404251:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790711938.404257:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1877696879806336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.404299:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1877696879806336:12345-0@lo:400:kworker.0 Request processed in 42us (2832us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711938.404863:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790711938.404882:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbfba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879807488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790711938.404935:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711938.404996:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879807488 00000100:00100000:1.0:1790711938.405003:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879807488 00000100:00100000:1.0:1790711938.405048:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790711938.405057:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879807488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790711938.405088:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790711938.405133:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879807488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711938.405140:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790711938.405196:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbfba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879807488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790711938.406073:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790711938.406116:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790711938.406130:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879806848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.406210:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1877696879806848:12345-0@lo:400:kworker.0 Request processed in 86us (4703us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711938.406217:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790711938.406231:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790711938.406238:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1877696879807360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.407205:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1877696879807360:12345-0@lo:400:kworker.0 Request processed in 959us (5630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711938.407216:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790711938.407246:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790711938.407257:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1877696879807104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.407330:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1877696879807104:12345-0@lo:400:kworker.0 Request processed in 77us (5592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711938.407337:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790711938.407351:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790711938.407358:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1877696879807232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.407391:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1877696879807232:12345-0@lo:400:kworker.0 Request processed in 34us (5407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711938.407397:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790711938.407442:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879806080 00000100:00100000:3.0:1790711938.407451:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879806080 00000100:00100000:3.0:1790711938.407491:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879806592 00000100:00100000:3.0:1790711938.407494:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879806592 00000100:00100000:3.0:1790711938.407508:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879806208 00000100:00100000:3.0:1790711938.407511:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879806208 00000100:00100000:3.0:1790711938.407521:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879806720 00000100:00100000:3.0:1790711938.407524:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879806720 00000100:00100000:3.0:1790711938.407562:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790711938.407570:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879806080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.407630:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879806080:12345-0@lo:400:kworker.0 Request processed in 61us (6001us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711938.407637:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790711938.407650:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790711938.407665:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879806592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.409328:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879806592:12345-0@lo:400:kworker.0 Request processed in 1654us (7633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711938.409343:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790711938.409373:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790711938.409385:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879806208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.409436:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879806208:12345-0@lo:400:kworker.0 Request processed in 56us (7660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711938.409442:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790711938.409454:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790711938.409461:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879806720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.409493:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879806720:12345-0@lo:400:kworker.0 Request processed in 33us (7683us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711938.409500:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1790711938.409561:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790711938.409567:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790711938.409571:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790711938.409574:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790711938.409624:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3608:1877696879806336:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.409641:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3608:1877696879806848:0@lo:400:kworker.0 00010000:00080000:3.0:1790711938.409658:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab8391e680 x1877696879807360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711938.409670:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8391e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3608:1877696879807360:0@lo:400:kworker.0 00000100:00100000:0.0:1790711938.413185:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879807616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790711938.413298:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711938.413376:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879806208:0@lo:400:kworker.0 00000100:00100000:0.0:1790711938.413392:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879806720:0@lo:400:kworker.0 00000100:00100000:0.0:1790711938.413407:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3609:1877696879807232:0@lo:400:kworker.0 00000100:00100000:0.0:1790711938.413419:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879806080:0@lo:400:kworker.0 00000100:00100000:0.0:1790711938.413452:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879806592:0@lo:400:kworker.0 00010000:00080000:0.0:1790711938.413469:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83bb7480 x1877696879807104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790711938.413481:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3609:1877696879807104:0@lo:400:kworker.0 00000100:00100000:0.0:1790711938.413519:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790711938.413527:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879807744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790711938.413574:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711938.413653:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879805952:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.413937:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879806464:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.413956:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3608:1877696879806976:0@lo:400:kworker.0 00000100:00100000:3.0:1790711938.414076:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790711938.414085:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8391e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879807872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790711938.414119:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711938.415980:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879807616 00000100:00100000:1.0:1790711938.416000:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879807616 00000100:00100000:1.0:1790711938.416057:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879807744 00000100:00100000:1.0:1790711938.416060:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879807744 00000100:00100000:1.0:1790711938.416073:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879807872 00000100:00100000:1.0:1790711938.416075:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879807872 00000100:00100000:1.0:1790711938.416093:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790711938.416103:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879807616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790711938.416145:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790711938.416255:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879807616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711938.416263:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790711938.417227:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790711938.417243:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879807744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790711938.417264:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790711938.417405:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879807744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 168us (3830us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711938.417413:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790711938.417634:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790711938.417643:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879807872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790711938.417656:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790711938.417899:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879807872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 257us (3779us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711938.417906:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790711938.417972:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879807744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790711938.417990:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879807616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790711938.418867:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8391e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879807872:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790711939.162758:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790711939.419112:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790711939.419143:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879808000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790711939.419236:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711939.419455:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879808000 00000100:00100000:0.0:1790711939.419466:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879808000 00000100:00100000:0.0:1790711939.419533:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790711939.419566:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879808000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790711939.419619:0:23610:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790711939.419837:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879808000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 293us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711939.419846:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790711939.419956:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879808000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790711939.420954:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8391ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879808128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790711939.421021:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711939.421117:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879808128 00000100:00100000:0.0:1790711939.421124:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879808128 00000100:00100000:0.0:1790711939.421174:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790711939.421184:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879808128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790711939.421217:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790711939.432494:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879808128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11293us (11454us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711939.432515:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790711939.439811:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8391ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879808128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790711939.518247:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711939.524321:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867102336 00000100:00100000:0.0:1790711939.524361:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867102336 00000100:00100000:0.0:1790711939.524445:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 146 00000100:00100000:0.0:1790711939.524456:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+11:18069:x1877696867102336:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790711939.524477:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711939.524502:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa650 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.524535:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa650 expref: 12 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.524561:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac9bef7200/0xcf3cf816241e0f3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa650 expref: 12 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.524572:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7200, rc 0) 00000100:00100000:0.0:1790711939.524667:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:18069:x1877696867102336:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 213us (6435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711939.524674:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 146 00000100:00100000:3.0:1790711939.533992:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711939.534291:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867102464 00000100:00100000:1.0:1790711939.534314:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867102464 00000100:00100000:1.0:1790711939.534380:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 147 00000100:00100000:1.0:1790711939.534392:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:18069:x1877696867102464:12345-192.168.203.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790711939.535959:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:18069:x1877696867102464:12345-192.168.203.6@tcp:501:ll_cfg_requeue.0 Request processed in 231us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711939.535978:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 147 00000100:00100000:3.0:1790711939.554390:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711939.554632:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867102592 00000100:00100000:2.0:1790711939.554647:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867102592 00000100:00100000:2.0:1790711939.554722:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 148 00000100:00100000:2.0:1790711939.554735:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:18069:x1877696867102592:12345-192.168.203.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790711939.554945:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:18069:x1877696867102592:12345-192.168.203.6@tcp:503:ll_cfg_requeue.0 Request processed in 212us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711939.554954:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 148 00000100:00100000:2.0:1790711939.583940:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711939.584141:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867102720 00000100:00100000:3.0:1790711939.584155:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867102720 00000100:00100000:3.0:1790711939.584228:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 149 00000100:00100000:3.0:1790711939.584239:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+12:18069:x1877696867102720:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790711939.584276:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711939.584311:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dacb5185000/0xcf3cf816241e0f44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa657 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.584347:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dacb5185000/0xcf3cf816241e0f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa657 expref: 13 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.584359:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dacb5185000/0xcf3cf816241e0f44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa657 expref: 13 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.584370:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacb5185000, rc 0) 00000100:00100000:3.0:1790711939.584449:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18069:x1877696867102720:12345-192.168.203.6@tcp:101:ll_cfg_requeue.0 Request processed in 211us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711939.584457:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 149 00000100:00100000:3.0:1790711939.593452:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711939.593952:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867102848 00000100:00100000:1.0:1790711939.593967:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867102848 00000100:00100000:1.0:1790711939.594092:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 150 00000100:00100000:1.0:1790711939.594109:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaefc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18069:x1877696867102848:12345-192.168.203.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790711939.594327:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaefc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18069:x1877696867102848:12345-192.168.203.6@tcp:501:ll_cfg_requeue.0 Request processed in 224us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711939.594354:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 150 00000100:00100000:0.0:1790711939.605455:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711939.605893:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867102976 00000100:00100000:2.0:1790711939.605907:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867102976 00000100:00100000:2.0:1790711939.605986:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 151 00000100:00100000:2.0:1790711939.605998:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18069:x1877696867102976:12345-192.168.203.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790711939.606197:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:18069:x1877696867102976:12345-192.168.203.6@tcp:503:ll_cfg_requeue.0 Request processed in 200us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711939.606207:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 151 00000040:00080000:2.0:1790711939.613833:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790711939.792082:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711939.792438:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867103104 00000100:00100000:3.0:1790711939.792449:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867103104 00000100:00100000:3.0:1790711939.792616:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:3.0:1790711939.792628:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:18693:x1877696867103104:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790711939.792650:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711939.792687:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e0f4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa65e expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.792762:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.792778:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.792790:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.792805:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.792812:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.792820:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.792921:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185400/0xcf3cf816241e0f60 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.792930:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185400/0xcf3cf816241e0f60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.792960:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185400/0xcf3cf816241e0f60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790711939.792991:0:22621:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790711939.792995:0:22621:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790711939.793031:0:22621:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185400/0xcf3cf816241e0f60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793043:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793049:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793056:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793063:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184000 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711939.793067:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793074:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793086:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab83008f00) 00010000:00010000:3.0:1790711939.793090:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711939.793094:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793101:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793135:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793154:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793161:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793167:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184800 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711939.793171:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793178:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793187:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9dab83006a00) 00010000:00010000:3.0:1790711939.793189:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711939.793192:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793198:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793247:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e0f4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa65e expref: 8 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793263:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185400/0xcf3cf816241e0f60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa65e expref: 7 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.793290:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dab83006f00) 00010000:00010000:3.0:1790711939.793293:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790711939.793295:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacb5185400, rc 0) 00000100:00100000:3.0:1790711939.793376:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:18693:x1877696867103104:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 Request processed in 752us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711939.793384:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00080000:2.0:1790711939.795332:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790711939.796090:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711939.796507:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867103232 00000100:00100000:1.0:1790711939.796517:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867103232 00000100:00100000:1.0:1790711939.796780:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:1.0:1790711939.796792:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:18693:x1877696867103232:12345-192.168.203.6@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1790711939.796923:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:18693:x1877696867103232:12345-192.168.203.6@tcp:900:lhsmtool_posix.0 Request processed in 132us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711939.796931:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:3.0:1790711939.801721:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711939.801862:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867103488 00000100:00100000:0.0:1790711939.801885:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867103488 00000100:00100000:0.0:1790711939.801940:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:0.0:1790711939.801950:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:18693:x1877696867103488:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790711939.801970:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711939.801991:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e0f67 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa665 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802076:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7000/0xcf3cf816241e0f6e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802119:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7000/0xcf3cf816241e0f6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802133:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7000/0xcf3cf816241e0f6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802150:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802158:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802165:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802296:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7e00/0xcf3cf816241e0f7c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802304:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7e00/0xcf3cf816241e0f7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802311:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7e00/0xcf3cf816241e0f7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790711939.802320:0:22622:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790711939.802486:0:22622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7000/0xcf3cf816241e0f6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802495:0:22622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7000/0xcf3cf816241e0f6e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802501:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7000/0xcf3cf816241e0f6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802513:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7000 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:0.0:1790711939.802517:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7000/0xcf3cf816241e0f6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802525:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7000/0xcf3cf816241e0f6e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802537:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9dab83006f00) 00010000:00010000:0.0:1790711939.802566:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790711939.802571:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7000/0xcf3cf816241e0f6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802577:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7000/0xcf3cf816241e0f6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802591:0:22622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802597:0:22622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f75 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802602:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802607:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7600 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:0.0:1790711939.802609:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802614:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f75 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802639:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9dab8222c600) 00010000:00010000:0.0:1790711939.802641:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790711939.802644:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f75 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.802649:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0f75 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.806743:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e0f67 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa665 expref: 10 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.806777:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7e00/0xcf3cf816241e0f7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa665 expref: 9 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.806788:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dab8222c700) 00010000:00010000:0.0:1790711939.806791:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790711939.806794:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7e00, rc 0) 00000100:00100000:0.0:1790711939.806890:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+9:18693:x1877696867103488:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 Request processed in 4941us (5177us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1790711939.806899:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:2.0:1790711939.817211:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711939.817664:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867103616 00000100:00100000:3.0:1790711939.817679:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867103616 00000100:00100000:3.0:1790711939.817750:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 25 00000100:00100000:3.0:1790711939.817761:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+9:18693:x1877696867103616:12345-192.168.203.6@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790711939.817899:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+9:18693:x1877696867103616:12345-192.168.203.6@tcp:59:lhsmtool_posix.0 Request processed in 140us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711939.817906:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 25 00000100:00100000:1.0:1790711939.820478:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711939.820613:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867103744 00000100:00100000:3.0:1790711939.820624:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867103744 00000100:00100000:3.0:1790711939.820694:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 26 00000100:00100000:3.0:1790711939.820704:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:18693:x1877696867103744:12345-192.168.203.6@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1790711939.820869:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1790711939.822487:0:22623:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1733us 00000100:00100000:1.0:1790711939.872042:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:18693:x1877696867103744:12345-192.168.203.6@tcp:59:lhsmtool_posix.0 Request processed in 51329us (51561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711939.872056:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 26 00000100:00100000:0.0:1790711939.922833:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711939.923007:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867103872 00000100:00100000:3.0:1790711939.923018:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867103872 00000100:00100000:3.0:1790711939.923077:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:3.0:1790711939.923088:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+9:18699:x1877696867103872:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:3.0:1790711939.923117:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711939.923153:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e0f8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa66c expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923219:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923234:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923272:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923337:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923345:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923353:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923396:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923404:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f91 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923411:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923416:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184800 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711939.923421:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923439:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923452:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab83008f00) 00010000:00010000:3.0:1790711939.923455:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711939.923461:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923466:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e0f91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923490:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923495:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923501:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923505:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184000 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711939.923508:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923513:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923519:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dab83006a00) 00010000:00010000:3.0:1790711939.923521:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711939.923524:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923538:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e0f98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923599:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e0f8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa66c expref: 10 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923610:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab83008f00) 00010000:00010000:3.0:1790711939.923612:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711939.923616:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e0f8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa66c expref: 10 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.923626:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacb5184200, rc 0) 00000100:00100000:3.0:1790711939.923685:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+9:18699:x1877696867103872:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 600us (861us total) trans 0 rc 301/301 00000100:00100000:3.0:1790711939.923693:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:3.0:1790711939.926965:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711939.927064:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867104000 00000100:00100000:0.0:1790711939.927075:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867104000 00000100:00100000:0.0:1790711939.927127:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 0 00000100:00100000:0.0:1790711939.927139:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e97fa3d-af78-4872-a8a1-4a103992cb38+9:18699:x1877696867104000:12345-192.168.203.6@tcp:700:lfs.0 00000100:00100000:0.0:1790711939.927222:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e97fa3d-af78-4872-a8a1-4a103992cb38+9:18699:x1877696867104000:12345-192.168.203.6@tcp:700:lfs.0 Request processed in 86us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711939.927250:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 0 10000000:01000000:3.0:1790711939.931494:0:22619:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790711939.931503:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dab82e88800 from 13 10000000:01000000:3.0:1790711939.931508:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790711939.931588:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5184600/0xcf3cf816241e0f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.931599:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dacb5184600/0xcf3cf816241e0f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.931610:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dacb5184600/0xcf3cf816241e0f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711939.931638:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8391c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879808256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790711939.931749:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711939.931792:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8502dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790711939.931978:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879808256 00000100:00100000:1.0:1790711939.931988:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879808256 00000100:00100000:1.0:1790711939.932047:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790711939.932056:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+20:22619:x1877696879808256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790711939.932070:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711939.932124:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab81dfb800/0xcf3cf816241e0fa6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0f9f expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711939.932148:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab81dfb800/0xcf3cf816241e0fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0f9f expref: 21 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711939.932158:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab81dfb800/0xcf3cf816241e0fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0f9f expref: 21 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711939.932167:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfb800, rc 0) 00000100:00100000:1.0:1790711939.932219:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:22619:x1877696879808256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711939.932226:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790711939.932571:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8391c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879808256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790711939.932589:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dacb5184600/0xcf3cf816241e0f9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fa6 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.932597:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dacb5184600/0xcf3cf816241e0f9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0fa6 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711939.932664:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879808384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790711939.932693:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711939.932721:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca01f09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790711939.933054:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879808384 00000100:00100000:2.0:1790711939.933060:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879808384 00000100:00100000:2.0:1790711939.933118:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790711939.933126:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:22619:x1877696879808384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790711939.933250:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:22619:x1877696879808384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711939.933257:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790711939.938326:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711939.938601:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879808384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790711939.938670:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879808512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790711939.938749:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711939.938786:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca01f09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790711939.938806:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867104256 00000100:00100000:0.0:1790711939.938811:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867104256 00000100:00100000:0.0:1790711939.938864:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:0.0:1790711939.938874:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+9:18699:x1877696867104256:12345-192.168.203.6@tcp:36:lfs.0 00010000:00010000:0.0:1790711939.938924:0:22622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711939.938950:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e0ef0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa5d9 expref: 9 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.938969:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab83008f00) 00010000:00010000:0.0:1790711939.938973:0:22622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790711939.939045:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.939059:0:22622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa649 expref: 5 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.939067:0:22622:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.939091:0:22622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa649 expref: 5 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.939104:0:22622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa649 expref: 5 pid: 22623 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711939.939115:0:22622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22622:1877696879808640:192.168.203.6@tcp:104: 00000100:00100000:0.0:1790711939.939162:0:22622:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca01f0480 going to sleep for 11 seconds 00000100:00100000:2.0:1790711939.939228:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879808512 00000100:00100000:2.0:1790711939.939233:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879808512 00000100:00100000:2.0:1790711939.939277:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790711939.939289:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:22619:x1877696879808512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790711939.939382:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:22619:x1877696879808512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711939.939390:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790711939.939777:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879808512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790711939.943936:0:25666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790711939.944243:0:22619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790711939.944285:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790711939.944298:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dacb5184600/0xcf3cf816241e0f9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fa6 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.944311:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dacb5184600/0xcf3cf816241e0f9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fa6 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711939.944321:0:22619:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790711939.944333:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dacbfa34800 from 13 10000000:01000000:2.0:1790711939.944337:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790711939.944373:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15800/0xcf3cf816241e0fb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.944382:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d15800/0xcf3cf816241e0fb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.944394:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d15800/0xcf3cf816241e0fb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711939.944418:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8398a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879808768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790711939.944483:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711939.944527:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4775180 going to sleep for 11 seconds 00000100:00100000:1.0:1790711939.944620:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879808768 00000100:00100000:1.0:1790711939.944628:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879808768 00000100:00100000:1.0:1790711939.944674:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790711939.944682:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+21:22619:x1877696879808768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790711939.944695:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711939.944707:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab81dfa800/0xcf3cf816241e0fbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0fb4 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711939.944731:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab81dfa800/0xcf3cf816241e0fbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0fb4 expref: 22 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711939.944742:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab81dfa800/0xcf3cf816241e0fbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0fb4 expref: 22 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711939.944751:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfa800, rc 0) 00000100:00100000:1.0:1790711939.944797:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:22619:x1877696879808768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711939.944805:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790711939.945192:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8398a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879808768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790711939.945207:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d15800/0xcf3cf816241e0fb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fbb expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.945217:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d15800/0xcf3cf816241e0fb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0fbb expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711939.945280:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879808896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790711939.945318:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711939.945359:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9daca01f0180 going to sleep for 11 seconds 00000100:00100000:1.0:1790711939.945406:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879808896 00000100:00100000:1.0:1790711939.945410:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879808896 00000100:00100000:1.0:1790711939.945443:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1790711939.945450:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:22619:x1877696879808896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790711939.945590:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:22619:x1877696879808896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711939.945597:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790711939.947375:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879808896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790711939.947440:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8398b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790711939.947515:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711939.947588:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4775d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790711939.947813:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879809024 00000100:00100000:1.0:1790711939.947820:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879809024 00000100:00100000:1.0:1790711939.947872:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790711939.947882:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:22619:x1877696879809024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790711939.947994:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:22619:x1877696879809024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711939.948002:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790711939.948473:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8398b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790711939.952515:0:25667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790711939.952953:0:22619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790711939.952978:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790711939.952989:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15800/0xcf3cf816241e0fb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fbb expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.953001:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d15800/0xcf3cf816241e0fb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fbb expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711939.953012:0:22619:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790711939.953032:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dacb5208000 from 13 10000000:01000000:2.0:1790711939.953035:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790711939.953073:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e0fc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.953082:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e0fc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.953093:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e0fc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711939.953118:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8398b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790711939.953183:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711939.953229:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4775d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790711939.955871:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879809152 00000100:00100000:1.0:1790711939.955886:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879809152 00000100:00100000:1.0:1790711939.955959:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790711939.955970:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+22:22619:x1877696879809152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790711939.955989:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711939.956009:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dab81dfac00/0xcf3cf816241e0fc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0fc2 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711939.956038:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dab81dfac00/0xcf3cf816241e0fc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0fc2 expref: 23 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711939.956049:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dab81dfac00/0xcf3cf816241e0fc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0fc2 expref: 23 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711939.956058:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfac00, rc 0) 00000100:00100000:1.0:1790711939.956135:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:22619:x1877696879809152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (2952us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711939.956141:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790711939.956297:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8398b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790711939.956316:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e0fc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fc9 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.956325:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e0fc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0fc9 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711939.956394:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8398b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790711939.956426:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711939.956466:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4775d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790711939.957075:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711939.957159:0:22622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22622:1877696879808640:192.168.203.6@tcp:104: 00010000:00010000:2.0:1790711939.957177:0:22622:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711939.957285:0:23376:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867104384 00000100:00100000:3.0:1790711939.957291:0:23376:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867104384 00010000:00010000:3.0:1790711939.957333:0:23376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa649 expref: 6 pid: 22623 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711939.957367:0:23376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 15 00000100:00100000:3.0:1790711939.957375:0:23376:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:201f8768-6771-4009-8040-f3ce7014ecea+6:2408:x1877696867104384:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790711939.957387:0:23376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790711939.957394:0:23376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa649 expref: 6 pid: 22623 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.957405:0:23376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa649 expref: 6 pid: 22623 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.957426:0:23376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e0f2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa649 expref: 6 pid: 22623 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.957442:0:23376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab83008f00) 00010000:00010000:3.0:1790711939.957447:0:23376:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.957455:0:23376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.957461:0:23376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.957503:0:23376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790711939.957575:0:23376:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:201f8768-6771-4009-8040-f3ce7014ecea+5:2408:x1877696867104384:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 167us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711939.957582:0:23376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 15 00000100:00080000:2.0:1790711939.957677:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790711939.957695:0:22622:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.957702:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.957736:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.957745:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.957754:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711939.959608:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879809280 00000100:00100000:1.0:1790711939.959623:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879809280 00000100:00100000:1.0:1790711939.959689:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790711939.959713:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:22619:x1877696879809280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790711939.959908:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:22619:x1877696879809280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711939.959916:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790711939.960240:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8398b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790711939.960316:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8391c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790711939.960370:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711939.960409:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8502da80 going to sleep for 11 seconds 00000100:00100000:0.0:1790711939.960537:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879809408 00000100:00100000:0.0:1790711939.960558:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879809408 00000100:00100000:0.0:1790711939.960594:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790711939.960601:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:22619:x1877696879809408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790711939.960695:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:22619:x1877696879809408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711939.960702:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790711939.961354:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8391c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790711939.964660:0:25668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790711939.964894:0:22619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790711939.964920:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790711939.964931:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e0fc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fc9 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.964943:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d15a00/0xcf3cf816241e0fc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fc9 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790711939.964953:0:22619:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790711939.964956:0:22619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9dacae5ff800 from 13 10000000:01000000:2.0:1790711939.964959:0:22619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790711939.964994:0:22619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14a00/0xcf3cf816241e0fd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.965002:0:22619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.106@tcp lock: ffff9dab82d14a00/0xcf3cf816241e0fd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.965014:0:22619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.106@tcp lock: ffff9dab82d14a00/0xcf3cf816241e0fd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711939.965047:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8398b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790711939.965112:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711939.965156:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4775d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790711939.965283:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879809536 00000100:00100000:0.0:1790711939.965290:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879809536 00000100:00100000:0.0:1790711939.965340:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790711939.965351:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+23:22619:x1877696879809536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790711939.965365:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711939.965378:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0fde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3cf816241e0fd7 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.965399:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0fde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3cf816241e0fd7 expref: 24 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.965409:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9dac9bef7000/0xcf3cf816241e0fde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3cf816241e0fd7 expref: 24 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711939.965417:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7000, rc 0) 00000100:00100000:0.0:1790711939.965470:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:22619:x1877696879809536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711939.965477:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790711939.970562:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8398b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790711939.970595:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.106@tcp lock: ffff9dab82d14a00/0xcf3cf816241e0fd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fde expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.970608:0:22619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.106@tcp lock: ffff9dab82d14a00/0xcf3cf816241e0fd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3cf816241e0fde expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711939.970700:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8391c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790711939.970780:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711939.970823:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8502da80 going to sleep for 11 seconds 00000100:00100000:1.0:1790711939.970840:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879809664 00000100:00100000:1.0:1790711939.970847:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879809664 00000100:00100000:1.0:1790711939.970900:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790711939.970911:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:22619:x1877696879809664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790711939.971054:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:22619:x1877696879809664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711939.971063:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790711939.971139:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8391c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790711939.971176:0:22619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8391c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790711939.971236:0:22619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711939.971259:0:22619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8502da80 going to sleep for 11 seconds 00010000:00010000:2.0:1790711939.971355:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971368:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971378:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790711939.971393:0:22622:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e39946e4 reply state 000000000263f517 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971404:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971413:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:2.0:1790711939.971415:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790711939.971423:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879809792 00000100:00100000:0.0:1790711939.971436:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879809792 00000100:00100000:0.0:1790711939.971473:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790711939.971480:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:22619:x1877696879809792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790711939.971598:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:22619:x1877696879809792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711939.971606:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790711939.971621:0:22622:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790711939.971628:0:22622:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790711939.971637:0:22622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971645:0:22622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971652:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971669:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7600 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711939.971674:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971682:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971693:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab83008f00) 00010000:00010000:2.0:1790711939.971697:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790711939.971701:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971708:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e0fad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711939.971715:0:22619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8391c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bc8ed208-5edc-469a-a5f9-449dbe325e20:22619:1877696879809792:0@lo:503:ll_cfg_requeue.0 00000004:00010000:2.0:1790711939.971742:0:22622:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e39946e4 reply state 000000000263f517 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971753:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711939.971760:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dac82435800) 00010000:00010000:2.0:1790711939.971762:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790711939.971764:0:22622:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790711939.971842:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+10:18699:x1877696867104256:12345-192.168.203.6@tcp:36:lfs.0 Request processed in 32966us (33524us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1790711939.971850:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 28 00000040:00080000:2.0:1790711939.977911:0:25669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790711939.980927:0:22619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790711939.980967:0:22619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790711939.980980:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.106@tcp lock: ffff9dab82d14a00/0xcf3cf816241e0fd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fde expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711939.980992:0:22619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.106@tcp lock: ffff9dab82d14a00/0xcf3cf816241e0fd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3cf816241e0fde expref: -99 pid: 22619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711940.126479:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711940.126584:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867104512 00000100:00100000:1.0:1790711940.126595:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867104512 00000100:00100000:1.0:1790711940.126658:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 29 00000100:00100000:1.0:1790711940.126669:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+10:18707:x1877696867104512:12345-192.168.203.6@tcp:101:lctl.0 00010000:00010000:1.0:1790711940.126696:0:24457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711940.126721:0:24457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e0fec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa673 expref: -99 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.126784:0:24457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfba00/0xcf3cf816241e0ff3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.126808:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfba00/0xcf3cf816241e0ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.126819:0:24457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfba00/0xcf3cf816241e0ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790711940.126894:0:24457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790711940.126898:0:24457:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790711940.126936:0:24457:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfba00/0xcf3cf816241e0ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.126961:0:24457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e0fec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa673 expref: 12 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.126982:0:24457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfba00/0xcf3cf816241e0ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa673 expref: 11 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.126991:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab8300dc00) 00010000:00010000:1.0:1790711940.126994:0:24457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790711940.126997:0:24457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfba00, rc 0) 00000100:00100000:1.0:1790711940.127065:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+11:18707:x1877696867104512:12345-192.168.203.6@tcp:101:lctl.0 Request processed in 398us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711940.127072:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 29 00000100:00100000:3.0:1790711940.170178:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711940.170524:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867104640 00000100:00100000:1.0:1790711940.170536:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867104640 00000100:00100000:1.0:1790711940.170634:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 30 00000100:00100000:1.0:1790711940.170643:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:201f8768-6771-4009-8040-f3ce7014ecea+5:18708:x1877696867104640:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:1.0:1790711940.170663:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711940.170684:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e0ffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa67a expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.170750:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa600/0xcf3cf816241e1001 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.170785:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa600/0xcf3cf816241e1001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.170797:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa600/0xcf3cf816241e1001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790711940.170840:0:22623:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790711940.170845:0:22623:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790711940.170867:0:22623:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa600/0xcf3cf816241e1001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.170891:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e0ffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa67a expref: 7 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.170921:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa600/0xcf3cf816241e1001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa67a expref: 6 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.170931:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab8300dc00) 00010000:00010000:1.0:1790711940.170934:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790711940.170937:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfa600, rc 0) 00000100:00100000:1.0:1790711940.170989:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:201f8768-6771-4009-8040-f3ce7014ecea+6:18708:x1877696867104640:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 347us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711940.170997:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 30 00000100:00100000:0.0:1790711940.182310:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711940.182449:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867104768 00000100:00100000:1.0:1790711940.182458:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867104768 00000100:00100000:1.0:1790711940.182517:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 31 00000100:00100000:1.0:1790711940.182528:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+6:18708:x1877696867104768:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:1.0:1790711940.182576:0:24457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711940.182614:0:24457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa681 expref: -99 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182675:0:24457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e100f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182689:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e100f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182701:0:24457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e100f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182713:0:24457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1016 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182720:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182726:0:24457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182812:0:24457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfae00/0xcf3cf816241e101d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182821:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfae00/0xcf3cf816241e101d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182827:0:24457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfae00/0xcf3cf816241e101d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790711940.182866:0:24457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790711940.182869:0:24457:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790711940.182889:0:24457:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfae00/0xcf3cf816241e101d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182907:0:24457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e100f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182922:0:24457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e100f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182928:0:24457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e100f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182934:0:24457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfbe00 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:1.0:1790711940.182938:0:24457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e100f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182945:0:24457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e100f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182957:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab8300dc00) 00010000:00010000:1.0:1790711940.182960:0:24457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790711940.182965:0:24457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e100f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182971:0:24457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e100f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182986:0:24457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182992:0:24457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1016 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.182998:0:24457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1016 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.183010:0:24457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfbc00 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:1.0:1790711940.183013:0:24457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1016 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.183020:0:24457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1016 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.183027:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dac82435800) 00010000:00010000:1.0:1790711940.183029:0:24457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790711940.183032:0:24457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1016 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.183037:0:24457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1016 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.183061:0:24457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa681 expref: 8 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.183074:0:24457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfae00/0xcf3cf816241e101d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa681 expref: 7 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.183081:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:1.0:1790711940.183082:0:24457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790711940.183084:0:24457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfae00, rc 0) 00000100:00100000:1.0:1790711940.183149:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+7:18708:x1877696867104768:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 624us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711940.183156:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 31 00010000:00010000:2.0:1790711940.187010:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711940.187612:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711940.187693:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867104896 00000100:00100000:1.0:1790711940.187720:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867104896 00000100:00100000:1.0:1790711940.187806:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00100000:1.0:1790711940.187817:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:201f8768-6771-4009-8040-f3ce7014ecea+5:18708:x1877696867104896:12345-192.168.203.6@tcp:900:lfs.0 00000100:00100000:1.0:1790711940.187905:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:201f8768-6771-4009-8040-f3ce7014ecea+5:18708:x1877696867104896:12345-192.168.203.6@tcp:900:lfs.0 Request processed in 90us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711940.187921:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00080000:2.0:1790711940.193568:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790711940.194641:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711940.194735:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867105152 00000100:00100000:3.0:1790711940.194745:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867105152 00000100:00100000:3.0:1790711940.194811:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 32 00000100:00100000:3.0:1790711940.194822:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8398a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:201f8768-6771-4009-8040-f3ce7014ecea+7:18708:x1877696867105152:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:3.0:1790711940.194844:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711940.194865:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e1024 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa688 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790711940.194963:0:22622:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790711940.195063:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e1024 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa688 expref: 9 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711940.195077:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab8300dc00) 00010000:00010000:3.0:1790711940.195080:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790711940.195085:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e1024 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa688 expref: 9 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711940.195103:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacb5184200, rc 0) 00000100:00100000:3.0:1790711940.195180:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8398a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:201f8768-6771-4009-8040-f3ce7014ecea+8:18708:x1877696867105152:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 360us (545us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1790711940.195188:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 32 00000100:00100000:3.0:1790711940.207473:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711940.207583:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867105408 00000100:00100000:1.0:1790711940.207593:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867105408 00000100:00100000:1.0:1790711940.207657:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 33 00000100:00100000:1.0:1790711940.207667:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+8:18708:x1877696867105408:12345-192.168.203.6@tcp:36:lfs.0 00010000:00010000:1.0:1790711940.207732:0:24457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790711940.207759:0:24457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfae00/0xcf3cf816241e101d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa681 expref: 8 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.207782:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:1.0:1790711940.207799:0:24457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790711940.207821:0:24457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.207836:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.207846:0:24457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790711940.208144:0:24457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ddf5eeda reply state 00000000551fcb14 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.208157:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.208171:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:1.0:1790711940.208174:0:24457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790711940.208176:0:24457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790711940.208184:0:24457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790711940.208277:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:201f8768-6771-4009-8040-f3ce7014ecea+9:18708:x1877696867105408:12345-192.168.203.6@tcp:36:lfs.0 Request processed in 611us (813us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1790711940.208284:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 33 00000100:00100000:0.0:1790711940.224084:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.224142:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.224175:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.224207:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.224230:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.224246:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.224284:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.224307:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.224337:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867106048 00000100:00100000:0.0:1790711940.224345:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867106048 00000100:00100000:0.0:1790711940.224392:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867105920 00000100:00100000:0.0:1790711940.224395:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867105920 00000100:00100000:0.0:1790711940.224416:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 56 00000100:00100000:2.0:1790711940.224524:0:22624:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867105664 00000100:00100000:2.0:1790711940.224529:0:22624:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867105664 00000100:00100000:2.0:1790711940.224600:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 2 00000100:00100000:2.0:1790711940.224609:0:22624:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:201f8768-6771-4009-8040-f3ce7014ecea+9:18708:x1877696867105664:12345-192.168.203.6@tcp:35:lfs.0 00000100:00100000:2.0:1790711940.224824:0:22624:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:201f8768-6771-4009-8040-f3ce7014ecea+10:18708:x1877696867105664:12345-192.168.203.6@tcp:35:lfs.0 Request processed in 215us (747us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1790711940.224831:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 2 00000100:00100000:3.0:1790711940.225018:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867106304 00000100:00100000:3.0:1790711940.225023:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867106304 00000100:00100000:3.0:1790711940.225056:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867106560 00000100:00100000:3.0:1790711940.225060:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867106560 00000100:00100000:3.0:1790711940.225072:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867106176 00000100:00100000:3.0:1790711940.225075:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867106176 00000100:00100000:3.0:1790711940.225087:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867106432 00000100:00100000:3.0:1790711940.225089:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867106432 00000100:00100000:3.0:1790711940.225103:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:3.0:1790711940.225109:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacaeb16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867106304:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1790711940.225151:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacaeb16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867106304:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 42us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711940.225157:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:3.0:1790711940.225282:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:3.0:1790711940.225290:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:201f8768-6771-4009-8040-f3ce7014ecea+5:2407:x1877696867106560:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1790711940.225316:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:201f8768-6771-4009-8040-f3ce7014ecea+5:2407:x1877696867106560:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 27us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711940.225322:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:3.0:1790711940.225334:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:3.0:1790711940.225339:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867106176:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1790711940.225361:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867106176:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 22us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711940.225391:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:3.0:1790711940.225403:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:3.0:1790711940.225409:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:201f8768-6771-4009-8040-f3ce7014ecea+5:2407:x1877696867106432:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1790711940.225447:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:201f8768-6771-4009-8040-f3ce7014ecea+5:2407:x1877696867106432:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 38us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711940.225453:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00080000:3.0:1790711940.225481:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790711940.225486:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790711940.225563:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867106048:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1790711940.225595:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867106048:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 36us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711940.225655:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867105792 00000100:00100000:1.0:1790711940.225660:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867105792 00000100:00100000:1.0:1790711940.225693:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 164 00000100:00100000:1.0:1790711940.225700:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab84b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:2407:x1877696867105792:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1790711940.225728:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab84b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:2407:x1877696867105792:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 28us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711940.225734:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 164 00000100:00100000:2.0:1790711940.226405:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 57 00000100:00100000:2.0:1790711940.226420:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+11:2407:x1877696867105920:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1790711940.226455:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+11:2407:x1877696867105920:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 43us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711940.226462:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 57 00000100:00100000:0.0:1790711940.230048:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 56 00000100:00100000:0.0:1790711940.234207:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711940.234327:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867106816 00000100:00100000:2.0:1790711940.234337:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867106816 00000100:00100000:2.0:1790711940.234406:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 34 00000100:00100000:2.0:1790711940.234416:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:201f8768-6771-4009-8040-f3ce7014ecea+10:18708:x1877696867106816:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:2.0:1790711940.234439:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711940.234461:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e1039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa68f expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234530:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1040 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234585:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1040 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234598:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1040 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234620:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1047 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234627:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234633:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790711940.234740:0:22621:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790711940.234829:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1040 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234837:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1040 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234844:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1040 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234850:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d15c00 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711940.234854:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1040 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234862:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1040 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234873:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab8300dc00) 00010000:00010000:2.0:1790711940.234876:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790711940.234880:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1040 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234895:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1040 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234911:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234916:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1047 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234922:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1047 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234927:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167d400 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711940.234930:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1047 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234936:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1047 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234943:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dac82435800) 00010000:00010000:2.0:1790711940.234945:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790711940.234948:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1047 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234955:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1047 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.234985:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e1039 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa68f expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.235009:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab8300dc00) 00010000:00010000:2.0:1790711940.235011:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790711940.235015:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e1039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa68f expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.235025:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d14200, rc 0) 00000100:00100000:2.0:1790711940.235091:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:201f8768-6771-4009-8040-f3ce7014ecea+11:18708:x1877696867106816:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 676us (894us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1790711940.235099:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 34 00000100:00100000:2.0:1790711940.239481:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.239579:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867106944 00000100:00100000:0.0:1790711940.239589:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867106944 00000100:00100000:0.0:1790711940.239646:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 35 00000100:00100000:0.0:1790711940.239654:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:201f8768-6771-4009-8040-f3ce7014ecea+11:18708:x1877696867106944:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:0.0:1790711940.239679:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711940.239700:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e1055 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa696 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.239808:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.239823:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.239834:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790711940.239857:0:22623:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790711940.239860:0:22623:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790711940.239880:0:22623:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.239902:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e1055 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa696 expref: 13 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.239930:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa696 expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.239938:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:0.0:1790711940.239941:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790711940.239960:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7c00, rc 0) 00000100:00100000:0.0:1790711940.240015:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:201f8768-6771-4009-8040-f3ce7014ecea+12:18708:x1877696867106944:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 362us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711940.240022:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 35 00000040:00080000:0.0:1790711940.251446:0:23375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790711940.253706:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711940.254235:0:22624:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867107072 00000100:00100000:2.0:1790711940.254249:0:22624:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867107072 00000100:00100000:2.0:1790711940.254342:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:2.0:1790711940.254353:0:22624:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:201f8768-6771-4009-8040-f3ce7014ecea+12:18708:x1877696867107072:12345-192.168.203.6@tcp:37:lfs.0 00000100:00100000:2.0:1790711940.263882:0:22624:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:201f8768-6771-4009-8040-f3ce7014ecea+12:18708:x1877696867107072:12345-192.168.203.6@tcp:37:lfs.0 Request processed in 9521us (10180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711940.263896:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 3 00000100:00100000:0.0:1790711940.268325:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711940.270615:0:22625:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867107328 00000100:00100000:3.0:1790711940.270629:0:22625:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867107328 00000100:00100000:3.0:1790711940.270698:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:3.0:1790711940.270706:0:22625:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5288450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:201f8768-6771-4009-8040-f3ce7014ecea+12:18708:x1877696867107328:12345-192.168.203.6@tcp:35:lfs.0 00000100:00100000:3.0:1790711940.271424:0:22625:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5288450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:201f8768-6771-4009-8040-f3ce7014ecea+13:18708:x1877696867107328:12345-192.168.203.6@tcp:35:lfs.0 Request processed in 716us (3177us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1790711940.271433:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 4 00000100:00100000:3.0:1790711940.328194:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711940.328310:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867107456 00000100:00100000:2.0:1790711940.328325:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867107456 00000100:00100000:2.0:1790711940.328407:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 36 00000100:00100000:2.0:1790711940.328418:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+11:18714:x1877696867107456:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:2.0:1790711940.328440:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711940.328463:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1063 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa69d expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.328607:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e106a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.328620:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e106a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.328632:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e106a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.328643:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e1071 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.328650:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e1071 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.328656:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e1071 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.328731:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167ce00/0xcf3cf816241e1078 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.328741:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167ce00/0xcf3cf816241e1078 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.328747:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167ce00/0xcf3cf816241e1078 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790711940.329335:0:22621:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790711940.329342:0:22621:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790711940.330158:0:22621:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167ce00/0xcf3cf816241e1078 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330179:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e106a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330187:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e106a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330194:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e106a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330201:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167d600 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:0.0:1790711940.330205:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e106a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330213:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e106a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330229:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab8300dc00) 00010000:00010000:0.0:1790711940.330232:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790711940.330237:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e106a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330243:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e106a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330301:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e1071 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330306:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e1071 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330313:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e1071 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330319:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167dc00 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:0.0:1790711940.330321:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e1071 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330327:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e1071 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330336:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dac82435800) 00010000:00010000:0.0:1790711940.330338:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790711940.330341:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e1071 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.330346:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e1071 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.331462:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1063 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa69d expref: 13 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.331498:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167ce00/0xcf3cf816241e1078 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa69d expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.331529:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:0.0:1790711940.331532:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790711940.331536:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac8167ce00, rc 0) 00000100:00100000:0.0:1790711940.331648:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+12:18714:x1877696867107456:12345-192.168.203.6@tcp:101:bash.0 Request processed in 3230us (3467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711940.331656:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 36 00000100:00100000:0.0:1790711940.337111:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711940.337441:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867107584 00000100:00100000:1.0:1790711940.337452:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867107584 00000100:00100000:1.0:1790711940.337521:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:1.0:1790711940.337532:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:18714:x1877696867107584:12345-192.168.203.6@tcp:900:bash.0 00000100:00100000:1.0:1790711940.337639:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:18714:x1877696867107584:12345-192.168.203.6@tcp:900:bash.0 Request processed in 109us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711940.337647:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:1.0:1790711940.341678:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.344588:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867107840 00000100:00100000:0.0:1790711940.344603:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867107840 00000100:00100000:0.0:1790711940.344675:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 37 00000100:00100000:0.0:1790711940.344685:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+12:18714:x1877696867107840:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:0.0:1790711940.344706:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711940.344729:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e107f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6a4 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.344854:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.344872:0:22623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa696 expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.344881:0:22623:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.344928:0:22623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa696 expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.344966:0:22623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa696 expref: 12 pid: 22623 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711940.344981:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab838c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22623:1877696879809920:192.168.203.6@tcp:104: 00000100:00100000:0.0:1790711940.345074:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4762240 going to sleep for 11 seconds 00000100:00100000:3.0:1790711940.351393:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711940.351480:0:22607:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867107968 00000100:00100000:1.0:1790711940.351513:0:22607:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867107968 00010000:00010000:1.0:1790711940.351614:0:22607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa696 expref: 13 pid: 22623 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711940.351695:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 16 00000100:00100000:1.0:1790711940.351705:0:22607:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:201f8768-6771-4009-8040-f3ce7014ecea+13:2407:x1877696867107968:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790711940.351720:0:22607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790711940.351726:0:22607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa696 expref: 13 pid: 22623 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.351741:0:22607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa696 expref: 13 pid: 22623 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.351762:0:22607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:1.0:1790711940.351768:0:22607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.351778:0:22607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.352706:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.352743:0:22607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790711940.352888:0:22607:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:201f8768-6771-4009-8040-f3ce7014ecea+13:2407:x1877696867107968:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 1181us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711940.352897:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 16 00010000:00010000:0.0:1790711940.353350:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e105c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa696 expref: 12 pid: 22623 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711940.353767:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab838c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22623:1877696879809920:192.168.203.6@tcp:104: 00010000:00010000:0.0:1790711940.353857:0:22623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.353870:0:22623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.353877:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.359977:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.359999:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.360030:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.360761:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e1094 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.360774:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e1094 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.360782:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e1094 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790711940.360868:0:22623:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790711940.360960:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.360969:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.360977:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.360983:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef6000 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:1.0:1790711940.360987:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.360995:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.361007:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:1.0:1790711940.361010:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790711940.361026:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.361032:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1086 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790711940.361048:0:22623:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ba7599fb reply state 000000005543a74a transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.361059:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.361065:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dab8300d500) 00010000:00010000:1.0:1790711940.361068:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790711940.361071:0:22623:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790711940.361108:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e107f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6a4 expref: 15 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.361124:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e1094 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6a4 expref: 14 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.361131:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:1.0:1790711940.361134:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1790711940.361136:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfbe00, rc 0) 00000100:00100000:1.0:1790711940.361222:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+15:18714:x1877696867107840:12345-192.168.203.6@tcp:101:bash.0 Request processed in 16537us (19563us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1790711940.361231:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 37 00000100:00100000:3.0:1790711940.391251:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.391376:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867108096 00000100:00100000:0.0:1790711940.391386:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867108096 00000100:00100000:0.0:1790711940.391452:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 38 00000100:00100000:0.0:1790711940.391463:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+15:18714:x1877696867108096:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:0.0:1790711940.391489:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711940.391510:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e10a2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6ab expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.391645:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e10a9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.391660:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e10a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.391671:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e10a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790711940.391715:0:22622:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790711940.391719:0:22622:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790711940.391736:0:22622:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e10a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.391745:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e10a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.391767:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e10a2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ab expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.391856:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e10a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ab expref: 16 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.391867:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711940.391870:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790711940.391873:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef6400, rc 0) 00000100:00100000:0.0:1790711940.392100:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+16:18714:x1877696867108096:12345-192.168.203.6@tcp:101:bash.0 Request processed in 638us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711940.392108:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 38 00000100:00100000:3.0:1790711940.404947:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711940.406173:0:22624:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867108352 00000100:00100000:2.0:1790711940.406188:0:22624:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867108352 00000100:00100000:2.0:1790711940.406351:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:2.0:1790711940.406364:0:22624:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+16:18714:x1877696867108352:12345-192.168.203.6@tcp:35:bash.0 00000100:00100000:2.0:1790711940.408067:0:22624:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+17:18714:x1877696867108352:12345-192.168.203.6@tcp:35:bash.0 Request processed in 1694us (3121us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1790711940.408082:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 5 00000100:00100000:2.0:1790711940.537654:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711940.537996:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867108608 00000100:00100000:1.0:1790711940.538010:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867108608 00000100:00100000:1.0:1790711940.538154:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:1.0:1790711940.538166:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+17:18724:x1877696867108608:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:1.0:1790711940.538208:0:24457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711940.538240:0:24457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e10b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6b2 expref: -99 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790711940.538355:0:24457:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790711940.538454:0:24457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e10b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6b2 expref: 19 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.538469:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab8300dc00) 00010000:00010000:1.0:1790711940.538472:0:24457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790711940.538477:0:24457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e10b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6b2 expref: 19 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711940.538494:0:24457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfb600, rc 0) 00000100:00100000:1.0:1790711940.538614:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+18:18724:x1877696867108608:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 450us (975us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1790711940.538622:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 39 00000100:00100000:3.0:1790711940.543516:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.543768:0:22625:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867108864 00000100:00100000:0.0:1790711940.543790:0:22625:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867108864 00000100:00100000:0.0:1790711940.543863:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00100000:0.0:1790711940.543872:0:22625:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8391e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+18:18724:x1877696867108864:12345-192.168.203.6@tcp:35:lfs.0 00000100:00100000:0.0:1790711940.544114:0:22625:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8391e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+19:18724:x1877696867108864:12345-192.168.203.6@tcp:35:lfs.0 Request processed in 241us (610us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1790711940.544123:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 6 00000100:00100000:3.0:1790711940.587759:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.587909:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867109120 00000100:00100000:0.0:1790711940.587924:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867109120 00000100:00100000:0.0:1790711940.588064:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 40 00000100:00100000:0.0:1790711940.588076:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+19:18727:x1877696867109120:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:0.0:1790711940.588103:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711940.588124:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e10be lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6b9 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.588244:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e10c5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.588257:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e10c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.588277:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e10c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790711940.588289:0:22622:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790711940.588410:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e10be lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6b9 expref: 22 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.588429:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e10c5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6b9 expref: 21 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.588457:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711940.588459:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790711940.588463:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef6200, rc 0) 00000100:00100000:0.0:1790711940.590247:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+21:18727:x1877696867109120:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 2166us (2496us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1790711940.590268:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 40 00000100:00100000:3.0:1790711940.596300:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711940.596403:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.596656:0:23376:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867109376 00000100:00100000:0.0:1790711940.596665:0:23376:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867109376 00000100:00100000:0.0:1790711940.596754:0:23376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 0 00000100:00100000:0.0:1790711940.596765:0:23376:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+21:2410:x1877696867109376:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790711940.596780:0:23376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711940.596804:0:23376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e10c5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6b9 expref: 21 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.596824:0:23376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711940.596829:0:23376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790711940.596888:0:23376:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+20:2410:x1877696867109376:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 125us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711940.596896:0:23376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 0 00000100:00100000:2.0:1790711940.601872:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867109248 00000100:00100000:2.0:1790711940.601887:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867109248 00000100:00100000:2.0:1790711940.601978:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 41 00000100:00100000:2.0:1790711940.601988:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+20:18727:x1877696867109248:12345-192.168.203.6@tcp:54:lfs.0 00010000:00010000:2.0:1790711940.602061:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10d3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.602079:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10d3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.602092:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10d3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.602127:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10d3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.602135:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10d3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.602142:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10d3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.602148:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167d600 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711940.602153:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10d3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.602180:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10d3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.602192:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:2.0:1790711940.602195:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790711940.602198:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10d3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.602205:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10d3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711940.602506:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+20:18727:x1877696867109248:12345-192.168.203.6@tcp:54:lfs.0 Request processed in 517us (6212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711940.602515:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 41 00000100:00100000:3.0:1790711940.606960:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711940.613873:0:22624:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867109632 00000100:00100000:2.0:1790711940.613888:0:22624:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867109632 00000100:00100000:2.0:1790711940.614032:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 7 00000100:00100000:2.0:1790711940.614046:0:22624:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+20:18727:x1877696867109632:12345-192.168.203.6@tcp:35:lfs.0 00000100:00100000:2.0:1790711940.614688:0:22624:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+21:18727:x1877696867109632:12345-192.168.203.6@tcp:35:lfs.0 Request processed in 643us (7735us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1790711940.615007:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 7 00000040:00080000:0.0:1790711940.637381:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790711940.979333:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711940.979469:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867109888 00000100:00100000:0.0:1790711940.979478:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867109888 00000100:00100000:0.0:1790711940.979578:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 42 00000100:00100000:0.0:1790711940.979589:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+21:18758:x1877696867109888:12345-192.168.203.6@tcp:101:cat.0 00010000:00010000:0.0:1790711940.979625:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711940.979663:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e10da lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6c0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.979768:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e10e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.979795:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e10e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.979808:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e10e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790711940.979819:0:22621:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790711940.979943:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e10da lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c0 expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.979964:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e10e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c0 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711940.979973:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711940.979976:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790711940.979979:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7c00, rc 0) 00000100:00100000:0.0:1790711940.980040:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+23:18758:x1877696867109888:12345-192.168.203.6@tcp:101:cat.0 Request processed in 452us (715us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1790711940.980048:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 42 00000100:00100000:3.0:1790711940.992648:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711940.992688:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711940.993212:0:22608:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867110272 00000100:00100000:2.0:1790711940.993223:0:22608:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867110272 00000100:00100000:2.0:1790711940.993309:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 1 00000100:00100000:2.0:1790711940.993320:0:22608:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+23:2407:x1877696867110272:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790711940.993336:0:22608:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711940.993361:0:22608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e10e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c0 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711940.993400:0:22608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:2.0:1790711940.993406:0:22608:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790711940.993492:0:22608:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+22:2407:x1877696867110272:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 173us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711940.993500:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 1 00000100:00100000:0.0:1790711940.993936:0:22625:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867110144 00000100:00100000:0.0:1790711940.993941:0:22625:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867110144 00000100:00100000:0.0:1790711940.993979:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 8 00000100:00100000:0.0:1790711940.993988:0:22625:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+22:18758:x1877696867110144:12345-192.168.203.6@tcp:35:cat.0 00000100:00100000:0.0:1790711940.994243:0:22625:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+23:18758:x1877696867110144:12345-192.168.203.6@tcp:35:cat.0 Request processed in 255us (1603us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1790711941.000740:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 8 00000100:00100000:3.0:1790711941.128419:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711941.129667:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867110528 00000100:00100000:2.0:1790711941.129678:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867110528 00000100:00100000:2.0:1790711941.129766:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00100000:2.0:1790711941.129779:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8329c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+23:18764:x1877696867110528:12345-192.168.203.6@tcp:101:dd.0 00010000:00010000:2.0:1790711941.129805:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711941.129826:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10ef lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6c7 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.129934:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.129949:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.129961:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790711941.129973:0:22623:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790711941.130117:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e10ef lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c7 expref: 26 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.130272:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c7 expref: 25 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.130299:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:2.0:1790711941.130303:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790711941.130307:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac8167dc00, rc 0) 00000100:00100000:2.0:1790711941.130382:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8329c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+25:18764:x1877696867110528:12345-192.168.203.6@tcp:101:dd.0 Request processed in 607us (1971us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1790711941.130390:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 43 00000100:00080000:3.0:1790711941.132595:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790711941.143992:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711941.144040:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711941.144188:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867110656 00000100:00100000:0.0:1790711941.144198:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867110656 00000100:00100000:0.0:1790711941.144280:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:0.0:1790711941.144291:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+25:18764:x1877696867110656:12345-192.168.203.6@tcp:101:dd.0 00010000:00010000:0.0:1790711941.144316:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711941.144340:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1104 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6ce expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711941.144393:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e110b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711941.144408:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e110b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711941.144418:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e110b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711941.144598:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1104 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ce expref: 27 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711941.144617:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e110b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ce expref: 26 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711941.144625:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711941.144628:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790711941.144639:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef6200, rc 0) 00000100:00100000:0.0:1790711941.144687:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+26:18764:x1877696867110656:12345-192.168.203.6@tcp:101:dd.0 Request processed in 397us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711941.144693:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 44 00000100:00100000:0.0:1790711941.151165:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711941.151247:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867111040 00000100:00100000:2.0:1790711941.151265:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867111040 00000100:00100000:2.0:1790711941.151340:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 45 00000100:00100000:2.0:1790711941.151350:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+26:18764:x1877696867111040:12345-192.168.203.6@tcp:36:dd.0 00010000:00010000:2.0:1790711941.151411:0:22623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711941.151438:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e10a9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ab expref: 26 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.151459:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:2.0:1790711941.151464:0:22623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790711941.151665:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.151681:0:22623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c7 expref: 26 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.151691:0:22623:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.151724:0:22623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c7 expref: 26 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.151757:0:22623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c7 expref: 26 pid: 22623 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711941.151772:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8398b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22623:1877696879810048:192.168.203.6@tcp:104: 00000100:00100000:2.0:1790711941.151848:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4775d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790711941.157005:0:23376:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867110784 00000100:00100000:1.0:1790711941.157020:0:23376:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867110784 00010000:00010000:1.0:1790711941.157078:0:23376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c7 expref: 27 pid: 22623 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711941.157120:0:23376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 17 00000100:00100000:1.0:1790711941.157130:0:23376:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5340a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+27:2409:x1877696867110784:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790711941.157146:0:23376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790711941.157154:0:23376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c7 expref: 27 pid: 22623 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711941.157188:0:23376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c7 expref: 27 pid: 22623 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711941.157213:0:23376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:1.0:1790711941.157219:0:23376:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711941.157228:0:23376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711941.157236:0:23376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711941.157951:0:23376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790711941.164392:0:23376:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5340a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+27:2409:x1877696867110784:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 7249us (20337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711941.164410:0:23376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 17 00010000:00010000:2.0:1790711941.165265:0:22623:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.6@tcp) returned -22 from blocking AST (req@0000000047dc6abe x1877696879810048) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 1/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c7 expref: 26 pid: 22623 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.165289:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e10f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6c7 expref: 26 pid: 22623 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711941.165305:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8398b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22623:1877696879810048:192.168.203.6@tcp:104: 00010000:00010000:2.0:1790711941.165326:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:2.0:1790711941.165334:0:22623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.165344:0:22623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.165350:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790711941.165445:0:22623:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1790711941.165495:0:22623:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000309f78b1 reply state 0000000054760e16 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.165530:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.165561:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:2.0:1790711941.165565:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790711941.165569:0:22623:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790711941.165679:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+27:18764:x1877696867111040:12345-192.168.203.6@tcp:36:dd.0 Request processed in 14329us (14521us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1790711941.165687:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 45 00000020:00080000:2.0:1790711941.165692:0:22623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790711941.210696:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711941.289215:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711941.289660:0:22624:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867111296 00000100:00100000:2.0:1790711941.289671:0:22624:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867111296 00000100:00100000:2.0:1790711941.289738:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 9 00000100:00100000:2.0:1790711941.289748:0:22624:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+27:18764:x1877696867111296:12345-192.168.203.6@tcp:35:dd.0 00000100:00100000:2.0:1790711941.289996:0:22624:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+28:18764:x1877696867111296:12345-192.168.203.6@tcp:35:dd.0 Request processed in 249us (789us total) trans 12884901907 rc 0/0 00000100:00100000:2.0:1790711941.290004:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 9 00000100:00100000:0.0:1790711941.557988:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711941.558476:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867111424 00000100:00100000:3.0:1790711941.558488:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867111424 00000100:00100000:3.0:1790711941.558585:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 46 00000100:00100000:3.0:1790711941.558596:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+28:18778:x1877696867111424:12345-192.168.203.6@tcp:101:stat.0 00010000:00010000:3.0:1790711941.558621:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711941.558642:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e1119 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6d5 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558720:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e1120 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558734:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e1120 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558744:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e1120 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558755:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1127 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558770:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1127 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558800:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1127 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558874:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185200/0xcf3cf816241e112e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558883:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185200/0xcf3cf816241e112e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558890:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185200/0xcf3cf816241e112e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790711941.558929:0:22621:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790711941.558933:0:22621:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790711941.558970:0:22621:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185200/0xcf3cf816241e112e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558982:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185200/0xcf3cf816241e112e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558990:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e1120 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.558995:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e1120 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559001:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e1120 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559007:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184000 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711941.559010:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e1120 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559024:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e1120 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559036:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:3.0:1790711941.559039:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711941.559044:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e1120 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559062:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184000/0xcf3cf816241e1120 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559094:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1127 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559099:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1127 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559105:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1127 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559109:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184800 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711941.559112:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1127 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559118:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1127 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559125:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dab8300d500) 00010000:00010000:3.0:1790711941.559127:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711941.559640:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1127 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.559658:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1127 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.561426:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e1119 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6d5 expref: 30 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.561463:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185200/0xcf3cf816241e112e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6d5 expref: 29 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711941.561472:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:3.0:1790711941.561474:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790711941.561478:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacb5185200, rc 0) 00000100:00100000:3.0:1790711941.561590:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+29:18778:x1877696867111424:12345-192.168.203.6@tcp:101:stat.0 Request processed in 2994us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711941.561599:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 46 00000100:00100000:3.0:1790711941.664411:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711941.664613:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867111680 00000100:00100000:0.0:1790711941.664627:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867111680 00000100:00100000:0.0:1790711941.664705:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 47 00000100:00100000:0.0:1790711941.664717:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+29:18784:x1877696867111680:12345-192.168.203.6@tcp:36:truncate.0 00010000:00010000:0.0:1790711941.664792:0:24457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711941.664836:0:24457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5185200/0xcf3cf816241e112e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6d5 expref: 29 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711941.664878:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711941.664883:0:24457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790711941.665112:0:24457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711941.665130:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711941.665141:0:24457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790711941.665195:0:24457:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:0.0:1790711941.665221:0:24457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009ab03ebe reply state 0000000097d699b3 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711941.665233:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711941.665330:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711941.665334:0:24457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790711941.665337:0:24457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790711941.665495:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+31:18784:x1877696867111680:12345-192.168.203.6@tcp:36:truncate.0 Request processed in 779us (1099us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1790711941.665504:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 47 00000020:00080000:0.0:1790711941.665511:0:24457:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790711941.882779:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711941.883748:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867111808 00000100:00100000:2.0:1790711941.883765:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867111808 00000100:00100000:2.0:1790711941.883846:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 48 00000100:00100000:2.0:1790711941.883857:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+31:18798:x1877696867111808:12345-192.168.203.6@tcp:101:stat.0 00010000:00010000:2.0:1790711941.883882:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711941.883904:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e113c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6dc expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.883975:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1143 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884018:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1143 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884032:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1143 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884046:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e114a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884054:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e114a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884061:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e114a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884148:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884157:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884164:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790711941.884208:0:22622:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1790711941.884213:0:22622:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790711941.884234:0:22622:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884247:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884277:0:22622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1143 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884284:0:22622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1143 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884291:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1143 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884297:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167d400 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711941.884302:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1143 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884309:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1143 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884321:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:2.0:1790711941.884324:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790711941.884328:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1143 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884333:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e1143 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884347:0:22622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e114a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884353:0:22622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e114a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884359:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e114a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884371:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d14200 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711941.884374:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e114a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884380:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e114a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884389:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dab8300d500) 00010000:00010000:2.0:1790711941.884391:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790711941.884394:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e114a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884400:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e114a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884430:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e113c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6dc expref: 33 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884444:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6dc expref: 32 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711941.884452:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:2.0:1790711941.884454:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790711941.884457:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d15c00, rc 0) 00000100:00100000:2.0:1790711941.884527:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+32:18798:x1877696867111808:12345-192.168.203.6@tcp:101:stat.0 Request processed in 672us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711941.884535:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 48 00000100:00100000:0.0:1790711942.042303:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.042440:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867112064 00000100:00100000:2.0:1790711942.042469:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867112064 00000100:00100000:2.0:1790711942.042531:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 49 00000100:00100000:2.0:1790711942.042585:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+32:18807:x1877696867112064:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:2.0:1790711942.042606:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711942.042628:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e1158 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6e3 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790711942.042728:0:22623:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790711942.042839:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e1158 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6e3 expref: 34 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.042854:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab8300dc00) 00010000:00010000:2.0:1790711942.042857:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790711942.042862:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e1158 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6e3 expref: 34 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.042876:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab82d14200, rc 0) 00000100:00100000:2.0:1790711942.042946:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+33:18807:x1877696867112064:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 407us (653us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1790711942.042954:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 49 00000100:00100000:3.0:1790711942.052425:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.052603:0:22624:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867112320 00000100:00100000:2.0:1790711942.052613:0:22624:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867112320 00000100:00100000:2.0:1790711942.052675:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 10 00000100:00100000:2.0:1790711942.052685:0:22624:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5288850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+33:18807:x1877696867112320:12345-192.168.203.6@tcp:35:lfs.0 00000100:00100000:2.0:1790711942.052908:0:22624:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5288850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+34:18807:x1877696867112320:12345-192.168.203.6@tcp:35:lfs.0 Request processed in 223us (492us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1790711942.052917:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 10 00000100:00100000:3.0:1790711942.142311:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.142439:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867112576 00000100:00100000:0.0:1790711942.142451:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867112576 00000100:00100000:0.0:1790711942.142516:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 50 00000100:00100000:0.0:1790711942.142527:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+34:18814:x1877696867112576:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:0.0:1790711942.142590:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711942.142614:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1166 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6ea expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.142727:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.142742:0:22621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e1094 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6a4 expref: 35 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.142753:0:22621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6dc expref: 35 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.142762:0:22621:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.142812:0:22621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6dc expref: 35 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.142826:0:22621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6dc expref: 35 pid: 22622 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711942.142841:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81ccce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22621:1877696879810176:192.168.203.6@tcp:104: 00010000:00010000:0.0:1790711942.142941:0:22621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e1094 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6a4 expref: 35 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.142951:0:22621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e1094 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6a4 expref: 35 pid: 22623 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711942.142960:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22621:1877696879810304:192.168.203.6@tcp:104: 00000100:00100000:0.0:1790711942.142986:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac871bed80 going to sleep for 11 seconds 00000100:00100000:0.0:1790711942.147598:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81ccce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22621:1877696879810176:192.168.203.6@tcp:104: 00000100:00100000:0.0:1790711942.147617:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22621:1877696879810304:192.168.203.6@tcp:104: 00010000:00010000:0.0:1790711942.147655:0:22621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711942.149905:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711942.150103:0:22607:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867112704 00000100:00100000:1.0:1790711942.150117:0:22607:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867112704 00010000:00010000:1.0:1790711942.150184:0:22607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6dc expref: 36 pid: 22622 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711942.150235:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:1.0:1790711942.150261:0:22607:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacafdc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+36:2408:x1877696867112704:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790711942.150278:0:22607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790711942.150285:0:22607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6dc expref: 36 pid: 22622 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.150336:0:22607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6dc expref: 36 pid: 22622 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.150366:0:22607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1151 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6dc expref: 36 pid: 22622 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.150388:0:22607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:1.0:1790711942.150394:0:22607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.150405:0:22607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.150413:0:22607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790711942.150486:0:22607:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacafdc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+35:2408:x1877696867112704:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 241us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711942.150494:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 18 00000100:00100000:3.0:1790711942.156676:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.156912:0:22606:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867112832 00000100:00100000:0.0:1790711942.156925:0:22606:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867112832 00010000:00010000:0.0:1790711942.156989:0:22606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e1094 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6a4 expref: 35 pid: 22623 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711942.157043:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:0.0:1790711942.157068:0:22606:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5340e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+35:2407:x1877696867112832:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790711942.157096:0:22606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711942.157104:0:22606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e1094 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6a4 expref: 35 pid: 22623 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.157118:0:22606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e1094 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6a4 expref: 35 pid: 22623 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.157146:0:22606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbe00/0xcf3cf816241e1094 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6a4 expref: 35 pid: 22623 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.157170:0:22606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711942.157176:0:22606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.157189:0:22606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.157198:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.157234:0:22606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790711942.157609:0:22621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.157619:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790711942.157641:0:22621:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1790711942.157806:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e1166 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ea expref: 36 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.157836:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ea expref: 35 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.157845:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:3.0:1790711942.157848:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790711942.157850:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7a00, rc 0) 00000100:00100000:0.0:1790711942.157956:0:22606:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5340e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+35:2407:x1877696867112832:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 888us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.157966:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 19 00000100:00100000:3.0:1790711942.159724:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+34:18814:x1877696867112576:12345-192.168.203.6@tcp:101:bash.0 Request processed in 17182us (17407us total) trans 12884901912 rc 0/0 00000100:00100000:3.0:1790711942.159738:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 50 00000100:00100000:3.0:1790711942.163707:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.163812:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867113088 00000100:00100000:2.0:1790711942.163824:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867113088 00000100:00100000:2.0:1790711942.163945:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 51 00000100:00100000:2.0:1790711942.163958:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+34:18814:x1877696867113088:12345-192.168.203.6@tcp:36:bash.0 00010000:00010000:2.0:1790711942.164318:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.164340:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.164353:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790711942.164407:0:22623:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:2.0:1790711942.164432:0:22623:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002f8f78b0 reply state 0000000001a9df89 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.164447:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.164456:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:2.0:1790711942.164459:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790711942.164464:0:22623:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790711942.164770:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+37:18814:x1877696867113088:12345-192.168.203.6@tcp:36:bash.0 Request processed in 813us (1075us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1790711942.164779:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 51 00000020:00080000:2.0:1790711942.164785:0:22623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790711942.166976:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.170687:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867113216 00000100:00100000:0.0:1790711942.170704:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867113216 00000100:00100000:0.0:1790711942.170813:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 52 00000100:00100000:0.0:1790711942.170825:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+37:18814:x1877696867113216:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:0.0:1790711942.170863:0:24457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711942.170886:0:24457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e1182 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6f1 expref: -99 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.170954:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e1182 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6f1 expref: 38 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.170969:0:24457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e1182 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6f1 expref: 38 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.170987:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711942.170990:0:24457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790711942.170995:0:24457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef6600, rc 0) 00000100:00100000:0.0:1790711942.171119:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+38:18814:x1877696867113216:12345-192.168.203.6@tcp:101:bash.0 Request processed in 296us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.171135:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 52 00000100:00100000:3.0:1790711942.183498:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711942.186608:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867113344 00000100:00100000:1.0:1790711942.186625:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867113344 00000100:00100000:1.0:1790711942.186710:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 53 00000100:00100000:1.0:1790711942.186721:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+38:18814:x1877696867113344:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:1.0:1790711942.186740:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790711942.186763:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb200/0xcf3cf816241e1189 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6f8 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.186855:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa000/0xcf3cf816241e1190 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.186886:0:22623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ea expref: 39 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.186896:0:22623:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa000/0xcf3cf816241e1190 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.186934:0:22623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ea expref: 39 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.186948:0:22623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ea expref: 39 pid: 22621 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711942.186962:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbfba5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22623:1877696879810432:192.168.203.6@tcp:104: 00000100:00100000:1.0:1790711942.187058:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac9b4b19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790711942.193374:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbfba5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22623:1877696879810432:192.168.203.6@tcp:104: 00010000:00010000:2.0:1790711942.193412:0:22623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa000/0xcf3cf816241e1190 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711942.204585:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711942.205526:0:22607:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867113472 00000100:00100000:1.0:1790711942.205562:0:22607:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867113472 00010000:00010000:1.0:1790711942.205607:0:22607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ea expref: 40 pid: 22621 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711942.205655:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 20 00000100:00100000:1.0:1790711942.205665:0:22607:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb5341f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+40:2408:x1877696867113472:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790711942.205681:0:22607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790711942.205687:0:22607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ea expref: 40 pid: 22621 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.205701:0:22607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ea expref: 40 pid: 22621 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.205739:0:22607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e116d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ea expref: 40 pid: 22621 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.205756:0:22607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:1.0:1790711942.205761:0:22607:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa000/0xcf3cf816241e1190 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.205771:0:22607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa000/0xcf3cf816241e1190 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.205778:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa000/0xcf3cf816241e1190 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.205815:0:22607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790711942.205869:0:22607:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5341f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+39:2408:x1877696867113472:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 205us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711942.205878:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 20 00010000:00010000:3.0:1790711942.206084:0:22623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa000/0xcf3cf816241e1190 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.206093:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa000/0xcf3cf816241e1190 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790711942.206146:0:22623:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790711942.206151:0:22623:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790711942.206171:0:22623:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa000/0xcf3cf816241e1190 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.206202:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb200/0xcf3cf816241e1189 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6f8 expref: 39 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.206220:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa000/0xcf3cf816241e1190 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6f8 expref: 38 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.206239:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:3.0:1790711942.206256:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790711942.206259:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dab81dfa000, rc 0) 00000100:00100000:3.0:1790711942.206295:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb5340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+38:18814:x1877696867113344:12345-192.168.203.6@tcp:101:bash.0 Request processed in 19577us (22811us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711942.206302:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 53 00000100:00100000:3.0:1790711942.217446:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.220080:0:23376:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867113728 00000100:00100000:2.0:1790711942.220095:0:23376:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867113728 00000100:00100000:2.0:1790711942.220180:0:23376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 2 00000100:00100000:2.0:1790711942.220191:0:23376:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+38:18814:x1877696867113728:12345-192.168.203.6@tcp:103:bash.0 00010000:00010000:2.0:1790711942.220208:0:23376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790711942.220232:0:23376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e1182 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6f1 expref: 38 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.220275:0:23376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa000/0xcf3cf816241e1190 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6f8 expref: 37 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.220288:0:23376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:2.0:1790711942.220293:0:23376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790711942.220361:0:23376:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+36:18814:x1877696867113728:12345-192.168.203.6@tcp:103:bash.0 Request processed in 172us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711942.220369:0:23376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 2 00000100:00100000:1.0:1790711942.232044:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.232279:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867113856 00000100:00100000:2.0:1790711942.232290:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867113856 00000100:00100000:2.0:1790711942.232353:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 54 00000100:00100000:2.0:1790711942.232364:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+36:18814:x1877696867113856:12345-192.168.203.6@tcp:58:bash.0 00010000:00010000:2.0:1790711942.232473:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.232492:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.232503:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790711942.233696:0:22621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790711942.233728:0:22621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1790711942.233920:0:22621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1790711942.234069:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+36:18814:x1877696867113856:12345-192.168.203.6@tcp:58:bash.0 Request processed in 1703us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711942.234082:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 54 00010000:00010000:2.0:1790711942.243380:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711942.244693:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.244785:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867113984 00000100:00100000:0.0:1790711942.244794:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867113984 00000100:00100000:0.0:1790711942.244852:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 55 00000100:00100000:0.0:1790711942.244863:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+36:18814:x1877696867113984:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:0.0:1790711942.244883:0:24457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711942.244905:0:24457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e119e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa6ff expref: -99 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.244958:0:24457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.244969:0:24457:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e119e lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ff expref: 37 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.245010:0:24457:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.245024:0:24457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e119e lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ff expref: 37 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.245038:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711942.245041:0:24457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790711942.245044:0:24457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e119e lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ff expref: 37 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.245051:0:24457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef6600, rc 0) 00000100:00100000:0.0:1790711942.245346:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+37:18814:x1877696867113984:12345-192.168.203.6@tcp:101:bash.0 Request processed in 484us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.245355:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 55 00000040:00080000:0.0:1790711942.683061:0:22655:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790711942.683071:0:22655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790711942.683099:0:22655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1790711942.683109:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1790711942.683255:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22655:1877696879810560:192.168.203.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790711942.683361:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac871bea80 going to sleep for 11 seconds 00000100:00100000:0.0:1790711942.698328:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22655:1877696879810560:192.168.203.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790711942.699414:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711942.700068:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867114112 00000100:00100000:3.0:1790711942.700093:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867114112 00000100:00100000:3.0:1790711942.700180:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 56 00000100:00100000:3.0:1790711942.700193:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+37:18816:x1877696867114112:12345-192.168.203.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790711942.700253:0:22622:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790711942.700856:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+37:18816:x1877696867114112:12345-192.168.203.6@tcp:53:lhsmtool_posix.0 Request processed in 663us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711942.700866:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 56 00000100:00100000:3.0:1790711942.707519:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.707790:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867114240 00000100:00100000:2.0:1790711942.707802:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867114240 00000100:00100000:2.0:1790711942.707880:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 57 00000100:00100000:2.0:1790711942.707889:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+37:18816:x1877696867114240:12345-192.168.203.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790711942.707985:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e11a5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.708006:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e11a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.708018:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e11a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.720406:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e11ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.720431:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e11ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.720446:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e11ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.720484:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11b3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.720512:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.720520:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790711942.720608:0:22623:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790711942.720613:0:22623:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790711942.720631:0:22623:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721198:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e11a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721210:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e11a5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721217:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e11a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721224:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167d400 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711942.721229:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e11a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721237:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e11a5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721259:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dab8222c700) 00010000:00010000:2.0:1790711942.721262:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790711942.721268:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e11a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721288:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d400/0xcf3cf816241e11a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721308:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e11ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721315:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e11ac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721321:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e11ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721327:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167dc00 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711942.721330:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e11ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721337:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e11ac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721344:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9dac82435a00) 00010000:00010000:2.0:1790711942.721347:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790711942.721350:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e11ac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721367:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167dc00/0xcf3cf816241e11ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721384:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721391:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11b3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721403:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11b3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721408:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac994ec800 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711942.721411:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11b3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721417:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11b3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721425:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:2.0:1790711942.721429:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790711942.721432:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11b3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.721438:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11b3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711942.721565:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+37:18816:x1877696867114240:12345-192.168.203.6@tcp:34:lhsmtool_posix.0 Request processed in 13648us (14033us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711942.721576:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 57 00000100:00100000:1.0:1790711942.732386:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.735534:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867114496 00000100:00100000:2.0:1790711942.735699:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867114496 00000100:00100000:2.0:1790711942.735980:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 58 00000100:00100000:2.0:1790711942.735993:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+37:18816:x1877696867114496:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790711942.736025:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711942.736054:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa706 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736230:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11c1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736265:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736279:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790711942.736293:0:22621:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790711942.736423:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736431:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11c1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736440:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736446:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac994ec600 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711942.736452:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736462:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11c1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736476:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:2.0:1790711942.736480:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790711942.736486:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11c1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736507:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11c1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736647:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11ba lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa706 expref: 39 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736658:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9dab8222c700) 00010000:00010000:2.0:1790711942.736660:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790711942.736665:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa706 expref: 39 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.736675:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac994ec800, rc 0) 00000100:00100000:2.0:1790711942.736777:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+38:18816:x1877696867114496:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 Request processed in 786us (4405us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1790711942.736786:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 58 00000100:00100000:1.0:1790711942.751478:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.751637:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867114624 00000100:00100000:0.0:1790711942.751651:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867114624 00000100:00100000:0.0:1790711942.751732:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 59 00000100:00100000:0.0:1790711942.751744:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+38:18816:x1877696867114624:12345-192.168.203.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790711942.751811:0:24457:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790711942.752834:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+38:18816:x1877696867114624:12345-192.168.203.6@tcp:53:lhsmtool_posix.0 Request processed in 1071us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.752847:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 59 00000100:00100000:1.0:1790711942.765876:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711942.766162:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867114880 00000100:00100000:3.0:1790711942.766176:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867114880 00000100:00100000:3.0:1790711942.766263:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 60 00000100:00100000:3.0:1790711942.766275:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+38:18816:x1877696867114880:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790711942.766303:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711942.766332:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e11cf lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa70d expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790711942.766983:0:22622:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:3.0:1790711942.766993:0:22622:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:3.0:1790711942.767011:0:22622:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1790711942.767332:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e11d6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.767357:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e11d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.767375:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e11d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.767763:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184200/0xcf3cf816241e11cf lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa70d expref: 41 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.767799:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e11d6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa70d expref: 40 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.767809:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dab8222c600) 00010000:00010000:0.0:1790711942.767812:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790711942.767816:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef6000, rc 0) 00000100:00100000:0.0:1790711942.769024:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+40:18816:x1877696867114880:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 Request processed in 2739us (3155us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1790711942.769038:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 60 00000100:00100000:1.0:1790711942.783166:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.784611:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867115136 00000100:00100000:2.0:1790711942.784632:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867115136 00000100:00100000:2.0:1790711942.784715:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 61 00000100:00100000:2.0:1790711942.784727:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+40:18816:x1877696867115136:12345-192.168.203.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790711942.784811:0:22623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711942.785024:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e11d6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa70d expref: 40 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785051:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dab8222c600) 00010000:00010000:2.0:1790711942.785065:0:22623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790711942.785099:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11e4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785132:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11e4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785144:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11e4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785162:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11eb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc51a0da2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785170:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc51a0da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785177:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc51a0da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785237:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11e4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785254:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11e4 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785261:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11e4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785267:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac994ec800 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711942.785272:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11e4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785280:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11e4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785289:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:2.0:1790711942.785297:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790711942.785302:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11e4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785308:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11e4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785320:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc51a0da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785325:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11eb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc51a0da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785330:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc51a0da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785334:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac994ec600 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:2.0:1790711942.785337:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc51a0da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785342:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11eb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc51a0da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785348:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xc51a0da2 (ffff9dac82435a00) 00010000:00010000:2.0:1790711942.785351:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790711942.785353:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11eb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc51a0da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.785358:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11eb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc51a0da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711942.785478:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+39:18816:x1877696867115136:12345-192.168.203.6@tcp:36:lhsmtool_posix.0 Request processed in 754us (2328us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790711942.785490:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 61 00000100:00100000:1.0:1790711942.798088:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.798208:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867115264 00000100:00100000:2.0:1790711942.798222:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867115264 00000100:00100000:2.0:1790711942.798654:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 62 00000100:00100000:2.0:1790711942.798669:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+39:18816:x1877696867115264:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790711942.798699:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711942.798913:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11f2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa714 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.799730:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11f9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.799748:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.799761:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.800194:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec600/0xcf3cf816241e11f2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa714 expref: 41 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.800219:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ec800/0xcf3cf816241e11f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa714 expref: 40 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.800229:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dac82435a00) 00010000:00010000:2.0:1790711942.800232:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790711942.800235:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac994ec800, rc 0) 00000100:00100000:2.0:1790711942.800342:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+40:18816:x1877696867115264:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 Request processed in 1676us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711942.800359:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 62 00000100:00100000:1.0:1790711942.812489:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711942.812674:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867115520 00000100:00100000:3.0:1790711942.812689:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867115520 00000100:00100000:3.0:1790711942.812778:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 63 00000100:00100000:3.0:1790711942.812791:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+40:18816:x1877696867115520:12345-192.168.203.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790711942.813279:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.813306:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.813320:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790711942.813692:0:22623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1790711942.813704:0:22623:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 708898163059ns, next at 709898160097ns, rc = 0 00000004:00010000:3.0:1790711942.813772:0:22623:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fac88b6f reply state 000000001824be90 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.813787:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.813796:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dac82435a00) 00010000:00010000:3.0:1790711942.813800:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790711942.813804:0:22623:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790711942.817374:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+42:18816:x1877696867115520:12345-192.168.203.6@tcp:36:lhsmtool_posix.0 Request processed in 2123us (2437us total) trans 12884901917 rc 0/0 00000100:00100000:3.0:1790711942.817425:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 63 00000100:00100000:1.0:1790711942.822994:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.823237:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867115648 00000100:00100000:2.0:1790711942.823262:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867115648 00000100:00100000:2.0:1790711942.823347:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 64 00000100:00100000:0.0:1790711942.823869:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbfba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+42:18816:x1877696867115648:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790711942.823917:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711942.823973:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1207 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa71b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.824472:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1207 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa71b expref: 43 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.824492:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1207 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa71b expref: 43 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.824515:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dac82435a00) 00010000:00010000:0.0:1790711942.824519:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790711942.824523:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7400, rc 0) 00000100:00100000:0.0:1790711942.824651:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbfba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+43:18816:x1877696867115648:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 Request processed in 1291us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.824660:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 64 00000100:00100000:1.0:1790711942.832837:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711942.833026:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867115776 00000100:00100000:3.0:1790711942.833040:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867115776 00000100:00100000:3.0:1790711942.833154:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:3.0:1790711942.833167:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab838c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2407:x1877696867115776:12345-192.168.203.6@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1790711942.833394:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790711942.839269:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab838c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:2407:x1877696867115776:12345-192.168.203.6@tcp:2:lhsmtool_posix.0 Request processed in 6095us (6440us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1790711942.839284:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:1.0:1790711942.843491:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.843722:0:22624:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867116032 00000100:00100000:2.0:1790711942.843732:0:22624:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867116032 00000100:00100000:2.0:1790711942.843794:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00100000:2.0:1790711942.843804:0:22624:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+43:18816:x1877696867116032:12345-192.168.203.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790711942.844039:0:22624:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+44:18816:x1877696867116032:12345-192.168.203.6@tcp:35:lhsmtool_posix.0 Request processed in 235us (557us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1790711942.844048:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 11 00000100:00100000:1.0:1790711942.857664:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.857748:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867116288 00000100:00100000:0.0:1790711942.857759:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867116288 00000100:00100000:0.0:1790711942.857839:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00100000:0.0:1790711942.857849:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+44:18816:x1877696867116288:12345-192.168.203.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790711942.857968:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+44:18816:x1877696867116288:12345-192.168.203.6@tcp:57:lhsmtool_posix.0 Request processed in 121us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.857990:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00100000:1.0:1790711942.862961:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.871566:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867116416 00000100:00100000:0.0:1790711942.871583:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867116416 00000100:00100000:0.0:1790711942.871682:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00100000:0.0:1790711942.871692:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+44:18816:x1877696867116416:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790711942.871714:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711942.871737:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e120e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa722 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.871840:0:22622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e1215 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.871861:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e1215 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.871875:0:22622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e1215 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790711942.871927:0:22622:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790711942.871948:0:22622:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e1215 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.871992:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e120e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa722 expref: 46 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.872013:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e1215 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa722 expref: 45 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.872023:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dac82435a00) 00010000:00010000:0.0:1790711942.872025:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790711942.872029:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7c00, rc 0) 00000100:00100000:0.0:1790711942.872089:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+45:18816:x1877696867116416:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 Request processed in 398us (9137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.872105:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00100000:1.0:1790711942.882491:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711942.882871:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867116544 00000100:00100000:3.0:1790711942.882882:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867116544 00000100:00100000:3.0:1790711942.882945:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 25 00000100:00100000:3.0:1790711942.882956:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+6:2408:x1877696867116544:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790711942.882984:0:24129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790711942.883007:0:24129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e121c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa729 expref: -99 pid: 24129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790711942.883035:0:24129:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abc1885, blocks: 0x0 00010000:00010000:3.0:1790711942.883056:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=708s v=(0 0) 00010000:00010000:3.0:1790711942.883061:0:24129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790711942.883071:0:24129:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e121c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa729 expref: 7 pid: 24129 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.883090:0:24129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e121c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa729 expref: 7 pid: 24129 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.883103:0:24129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dacb5184000, rc 0) 00000100:00100000:3.0:1790711942.883298:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:2408:x1877696867116544:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 Request processed in 342us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711942.883325:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 25 00000100:00100000:1.0:1790711942.889607:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.889737:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867116800 00000100:00100000:0.0:1790711942.889747:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867116800 00000100:00100000:0.0:1790711942.889807:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:0.0:1790711942.889816:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb51b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+45:18816:x1877696867116800:12345-192.168.203.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790711942.889928:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb51b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+45:18816:x1877696867116800:12345-192.168.203.6@tcp:57:lhsmtool_posix.0 Request processed in 112us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.889935:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:1.0:1790711942.895199:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.895597:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867116928 00000100:00100000:0.0:1790711942.895607:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867116928 00000100:00100000:0.0:1790711942.895685:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 68 00000100:00100000:0.0:1790711942.895695:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+45:18816:x1877696867116928:12345-192.168.203.6@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790711942.901799:0:22601:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1790711942.901835:0:22601:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1790711942.901920:0:22601:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1790711942.901945:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.901967:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.901987:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.901994:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d14800 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711942.901999:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902008:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902026:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9dac82435800) 00010000:00010000:3.0:1790711942.902029:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711942.902034:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902041:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14800/0xcf3cf816241e0fd0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902068:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902075:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902101:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902107:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d14400 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711942.902110:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902117:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902126:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:3.0:1790711942.902128:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711942.902131:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902138:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14400/0xcf3cf816241e0fe5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902165:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902172:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902179:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902184:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfbc00 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711942.902187:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902205:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902214:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dab8300d500) 00010000:00010000:3.0:1790711942.902216:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711942.902219:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902225:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e108d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902272:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902280:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902287:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902292:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac8167d600 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711942.902296:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902302:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902310:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:3.0:1790711942.902313:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711942.902316:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902328:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac8167d600/0xcf3cf816241e1112 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902341:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902349:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902355:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902360:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7600 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711942.902363:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902369:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902377:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:3.0:1790711942.902379:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711942.902382:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902388:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1135 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902399:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902406:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902418:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902423:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d14200 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711942.902427:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902433:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902441:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:3.0:1790711942.902443:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790711942.902446:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902452:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d14200/0xcf3cf816241e117b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902464:0:3594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902471:0:3594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902478:0:3594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902483:0:3594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dacb5184800 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:3.0:1790711942.902486:0:3594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902505:0:3594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902515:0:3594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dac82435a00) 00010000:00010000:3.0:1790711942.902517:0:3594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790711942.902520:0:3594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.902526:0:3594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dacb5184800/0xcf3cf816241e1200 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711942.905269:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790711942.905302:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879810688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790711942.905392:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790711942.905605:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.905618:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.905626:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.905632:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfa200 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:0.0:1790711942.905637:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.905655:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.905690:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:0.0:1790711942.905693:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790711942.905698:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.905705:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa200/0xcf3cf816241e1032 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711942.905846:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+14:18816:x1877696867116928:12345-192.168.203.6@tcp:44:lhsmtool_posix.0 Request processed in 10148us (10654us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.905856:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 68 00000100:00100000:1.0:1790711942.906268:0:24130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879810688 00000100:00100000:1.0:1790711942.906277:0:24130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879810688 00000100:00100000:1.0:1790711942.906350:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790711942.906360:0:24130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1877696879810688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790711942.906490:0:24130:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790711942.906493:0:24130:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790711942.906496:0:24130:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790711942.906498:0:24130:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1790711941 -> 1790711941 00002000:00010000:1.0:1790711942.906500:0:24130:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790711942.906579:0:24130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3609:x1877696879810688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (1186us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1790711942.906587:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1790711942.906688:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1790711942.906693:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9dacbc44a300/2, rc 0, transno 12884901892 00000100:00100000:3.0:1790711942.906710:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3609:1877696879810688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790711942.921864:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711942.921976:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867117056 00000100:00100000:3.0:1790711942.921989:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867117056 00000100:00100000:3.0:1790711942.922068:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:3.0:1790711942.922095:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:2407:x1877696867117056:12345-192.168.203.6@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790711942.922368:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc449180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:2407:x1877696867117056:12345-192.168.203.6@tcp:16:lhsmtool_posix.0 Request processed in 275us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711942.922376:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 27 00000100:00100000:2.0:1790711942.928086:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.928453:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867117312 00000100:00100000:0.0:1790711942.928468:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867117312 00000100:00100000:0.0:1790711942.928595:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 69 00000100:00100000:0.0:1790711942.928607:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab8398b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+14:18816:x1877696867117312:12345-192.168.203.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790711942.928685:0:24457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711942.928720:0:24457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7c00/0xcf3cf816241e1215 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa722 expref: 14 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.928743:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dac82435a00) 00010000:00010000:0.0:1790711942.928749:0:24457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790711942.928788:0:24457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e1223 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.928803:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e1223 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.928813:0:24457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e1223 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790711942.928993:0:24457:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000047dc6abe reply state 0000000017bb379e transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e1223 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.929007:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6400/0xcf3cf816241e1223 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.929013:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dac82435a00) 00010000:00010000:0.0:1790711942.929015:0:24457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790711942.929018:0:24457:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790711942.929149:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab8398b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+15:18816:x1877696867117312:12345-192.168.203.6@tcp:36:lhsmtool_posix.0 Request processed in 545us (1093us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1790711942.929158:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 69 00000100:00100000:1.0:1790711942.933731:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.933841:0:24130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867117440 00000100:00100000:0.0:1790711942.933854:0:24130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867117440 00000100:00100000:0.0:1790711942.933925:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:0.0:1790711942.933937:0:24130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:18816:x1877696867117440:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790711942.933964:0:24130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711942.933990:0:24130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa730 expref: -99 pid: 24130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.934030:0:24130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e121c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa729 expref: 8 pid: 24129 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.934042:0:24130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790711942.934047:0:24130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790711942.934053:0:24130:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 8 pid: 24130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.934134:0:24130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e121c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa729 expref: 8 pid: 24129 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.934150:0:24130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e121c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa729 expref: 8 pid: 24129 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711942.934168:0:24130:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24130:1877696879810816:192.168.203.6@tcp:104: 00000100:00100000:0.0:1790711942.934284:0:24130:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dab838cbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790711942.938230:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.938629:0:24130:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24130:1877696879810816:192.168.203.6@tcp:104: 00010000:00010000:0.0:1790711942.938677:0:24130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 8 pid: 24130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.938706:0:24130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7600, rc 0) 00000100:00100000:0.0:1790711942.938785:0:24130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+8:18816:x1877696867117440:12345-192.168.203.6@tcp:101:lhsmtool_posix.0 Request processed in 4850us (5068us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.938796:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 28 00000100:00100000:2.0:1790711942.938908:0:22607:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867117568 00000100:00100000:2.0:1790711942.938919:0:22607:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867117568 00010000:00010000:2.0:1790711942.938965:0:22607:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e121c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa729 expref: 8 pid: 24129 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711942.939005:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:2.0:1790711942.939015:0:22607:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc448a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+8:2408:x1877696867117568:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790711942.939032:0:22607:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711942.939062:0:22607:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e121c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa729 expref: 8 pid: 24129 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.939102:0:22607:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e121c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa729 expref: 8 pid: 24129 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.939133:0:22607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016895475/0xcf3cf816241e121c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa729 expref: 8 pid: 24129 timeout: 809 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.939165:0:22607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790711942.939171:0:22607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790711942.939178:0:22607:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 7 pid: 24130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.939189:0:22607:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 7 pid: 24130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.939228:0:22607:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 7 pid: 24130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711942.939352:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83989180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22607:1877696879810944:192.168.203.6@tcp:105: 00000100:00100000:2.0:1790711942.939425:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac876fdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790711942.942640:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83989180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22607:1877696879810944:192.168.203.6@tcp:105: 00010000:00010000:1.0:1790711942.942678:0:22607:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790711942.942758:0:22607:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc448a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:2408:x1877696867117568:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 3742us (4540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711942.942770:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 21 00000100:00100000:1.0:1790711942.944848:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711942.944939:0:24129:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867117696 00000100:00100000:3.0:1790711942.944953:0:24129:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867117696 00000100:00100000:3.0:1790711942.945028:0:24129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 29 00000100:00100000:3.0:1790711942.945039:0:24129:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:2407:x1877696867117696:12345-192.168.203.6@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790711942.945506:0:24129:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790711942.945511:0:24129:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1790711941 00002000:00010000:3.0:1790711942.945513:0:24129:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1790711939 00002000:00010000:3.0:1790711942.945516:0:24129:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1790711941 -> 1790711941 00002000:00010000:3.0:1790711942.945519:0:24129:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1790711942.945790:0:24129:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+8:2407:x1877696867117696:12345-192.168.203.6@tcp:2:lhsmtool_posix.0 Request processed in 750us (954us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1790711942.945800:0:24129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 29 00000100:00100000:3.0:1790711942.948776:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.948888:0:24127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867117824 00000100:00100000:0.0:1790711942.948902:0:24127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867117824 00000100:00100000:0.0:1790711942.949024:0:24127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 30 00000100:00100000:0.0:1790711942.949037:0:24127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+8:2409:x1877696867117824:12345-192.168.203.6@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790711942.949119:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.949166:0:24127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 8 pid: 24130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.949176:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790711942.949181:0:24127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790711942.949185:0:24127:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.949232:0:24127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 8 pid: 24130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.949266:0:24127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 8 pid: 24130 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711942.949284:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24127:1877696879811072:192.168.203.6@tcp:104: 00000100:00100000:0.0:1790711942.949416:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dab838cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790711942.952394:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.952659:0:23376:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867117952 00000100:00100000:2.0:1790711942.952672:0:23376:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867117952 00010000:00010000:2.0:1790711942.952724:0:23376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 9 pid: 24130 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711942.952805:0:23376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 22 00000100:00100000:2.0:1790711942.952816:0:23376:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83227b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+9:2407:x1877696867117952:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790711942.952836:0:23376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711942.952864:0:23376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 9 pid: 24130 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.952879:0:23376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 9 pid: 24130 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.952910:0:23376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790711942.952916:0:23376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790711942.952924:0:23376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.952935:0:23376:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.952959:0:23376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790711942.953026:0:23376:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83227b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+9:2407:x1877696867117952:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 211us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711942.953034:0:23376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 22 00010000:00010000:0.0:1790711942.954334:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000083ab3d2/0xcf3cf816241e122a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa730 expref: 8 pid: 24130 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711942.954363:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24127:1877696879811072:192.168.203.6@tcp:104: 00010000:00010000:0.0:1790711942.954393:0:24127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.954408:0:24127:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.954447:0:24127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.954486:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.954496:0:24127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.954506:0:24127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.954514:0:24127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7c00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:0.0:1790711942.954519:0:24127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.954529:0:24127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.954606:0:24127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.954614:0:24127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1231 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711942.954734:0:24127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:2409:x1877696867117824:12345-192.168.203.6@tcp:1:lhsmtool_posix.0 Request processed in 5698us (5972us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.954744:0:24127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 30 00000100:00100000:3.0:1790711942.958334:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:1.0:1790711942.958878:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867118208 00000100:00100000:1.0:1790711942.958919:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867118208 00000100:00100000:1.0:1790711942.959000:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 70 00000100:00100000:1.0:1790711942.959011:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+15:18816:x1877696867118208:12345-192.168.203.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790711942.959286:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.959315:0:22621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e110b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ce expref: 15 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.959327:0:22621:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.959369:0:22621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e110b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ce expref: 15 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.959385:0:22621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e110b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ce expref: 15 pid: 22621 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711942.959402:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc449c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22621:1877696879811200:192.168.203.6@tcp:104: 00000100:00100000:1.0:1790711942.959497:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac9b4b19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790711942.969150:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.969208:0:22608:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867118336 00000100:00100000:0.0:1790711942.969223:0:22608:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867118336 00010000:00010000:0.0:1790711942.969291:0:22608:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e110b lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ce expref: 16 pid: 22621 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711942.969359:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:0.0:1790711942.969371:0:22608:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83988380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+16:2407:x1877696867118336:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790711942.969390:0:22608:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790711942.969398:0:22608:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e110b lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ce expref: 16 pid: 22621 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.969414:0:22608:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e110b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ce expref: 16 pid: 22621 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.969443:0:22608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711942.969450:0:22608:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e119e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ff expref: 16 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.969464:0:22608:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.969475:0:22608:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.969507:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.969532:0:22608:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790711942.969640:0:22608:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83988380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+16:2407:x1877696867118336:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 270us (507us total) trans 0 rc 0/0 00010000:00010000:1.0:1790711942.969651:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e110b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ce expref: 16 pid: 22621 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711942.969652:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:1.0:1790711942.969680:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc449c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22621:1877696879811200:192.168.203.6@tcp:104: 00010000:00010000:1.0:1790711942.969707:0:22621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.969719:0:22621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.969732:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.969992:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.970006:0:22621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1207 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa71b expref: 15 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.970014:0:22621:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.970049:0:22621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1207 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa71b expref: 15 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.970065:0:22621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1207 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa71b expref: 15 pid: 22621 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711942.970097:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc449c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22621:1877696879811328:192.168.203.6@tcp:104: 00000100:00100000:1.0:1790711942.970158:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac8407d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790711942.972976:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711942.973067:0:23376:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867118464 00000100:00100000:2.0:1790711942.973094:0:23376:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867118464 00010000:00010000:2.0:1790711942.973166:0:23376:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1207 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa71b expref: 16 pid: 22621 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790711942.973215:0:23376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:2.0:1790711942.973226:0:23376:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dac87a01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+16:2407:x1877696867118464:12345-192.168.203.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790711942.973259:0:23376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790711942.973266:0:23376:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1207 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa71b expref: 16 pid: 22621 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.973281:0:23376:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1207 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa71b expref: 16 pid: 22621 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.973787:0:23376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dac82435a00) 00010000:00010000:2.0:1790711942.973797:0:23376:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.973812:0:23376:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.973821:0:23376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711942.973846:0:23376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790711942.973963:0:23376:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dac87a01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+16:2407:x1877696867118464:12345-192.168.203.6@tcp:103:ldlm_bl.0 Request processed in 737us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711942.973974:0:23376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 24 00010000:00010000:3.0:1790711942.974165:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1207 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa71b expref: 15 pid: 22621 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790711942.974183:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc449c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22621:1877696879811328:192.168.203.6@tcp:104: 00010000:00010000:3.0:1790711942.974208:0:22621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.974218:0:22621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.974225:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790711942.974401:0:22621:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:3.0:1790711942.974579:0:22621:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:3.0:1790711942.974628:0:22621:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:3.0:1790711942.974727:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab830bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22621:1877696879811456:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790711942.974814:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711942.974857:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacb4775d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790711942.975294:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879811456 00000100:00100000:2.0:1790711942.975315:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879811456 00000100:00100000:2.0:1790711942.975380:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790711942.975398:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22621:x1877696879811456:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790711942.975521:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22621:x1877696879811456:12345-0@lo:1000:mdt00_000.0 Request processed in 125us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711942.975528:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790711942.975651:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab830bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22621:1877696879811456:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1790711942.975867:0:22621:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1790711942.975938:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc44b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22621:1877696879811584:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790711942.975979:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711942.976005:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dac85770cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790711942.976335:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879811584 00000100:00100000:2.0:1790711942.976343:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879811584 00000100:00100000:2.0:1790711942.976391:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790711942.976399:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22621:x1877696879811584:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790711942.976572:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22621:x1877696879811584:12345-0@lo:1000:mdt00_000.0 Request processed in 174us (592us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1790711942.976579:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790711942.976666:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc44b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22621:1877696879811584:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1790711942.976730:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976743:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976752:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976759:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfb600 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:1.0:1790711942.976765:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976773:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976791:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dac82435a00) 00010000:00010000:1.0:1790711942.976795:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790711942.976800:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976807:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfb600/0xcf3cf816241e123f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976847:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976855:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976861:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976878:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab82d15c00 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:1.0:1790711942.976882:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976888:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976898:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:1.0:1790711942.976900:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790711942.976909:0:22621:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e119e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ff expref: 18 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976921:0:22621:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e119e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ff expref: 18 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976931:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e119e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ff expref: 18 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.976994:0:22621:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6600/0xcf3cf816241e119e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa6ff expref: 18 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711942.977008:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc44ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22621:1877696879811712:192.168.203.6@tcp:105: 00000100:00100000:1.0:1790711942.977189:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff9dacaf9decc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790711942.984578:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.984662:0:22624:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867118592 00000100:00100000:0.0:1790711942.984675:0:22624:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867118592 00000100:00100000:0.0:1790711942.984745:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:0.0:1790711942.984756:0:22624:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+19:18814:x1877696867118592:12345-192.168.203.6@tcp:49:bash.0 00000100:00100000:0.0:1790711942.984931:0:22624:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+19:18814:x1877696867118592:12345-192.168.203.6@tcp:49:bash.0 Request processed in 177us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.984938:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 12 00000100:00100000:1.0:1790711942.985186:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc44ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22621:1877696879811712:192.168.203.6@tcp:105: 00010000:00010000:1.0:1790711942.985221:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985264:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab82d15c00/0xcf3cf816241e1197 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985306:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1246 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985323:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1246 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985335:0:22621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1246 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985347:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1246 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985354:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1246 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985361:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1246 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985368:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfbc00 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:1.0:1790711942.985373:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1246 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985381:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1246 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985395:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:1.0:1790711942.985399:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790711942.985402:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1246 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985416:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfbc00/0xcf3cf816241e1246 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985429:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985435:0:22621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985441:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985445:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dab81dfa400 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:1.0:1790711942.985449:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985455:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985463:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:1.0:1790711942.985465:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790711942.985468:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790711942.985474:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dab81dfa400/0xcf3cf816241e1238 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790711942.985691:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+18:18816:x1877696867118208:12345-192.168.203.6@tcp:57:lhsmtool_posix.0 Request processed in 26681us (27372us total) trans 12884901924 rc 0/0 00000100:00100000:1.0:1790711942.985700:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 70 00000020:00080000:1.0:1790711942.985711:0:22621:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790711942.986038:0:22655:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790711942.986045:0:22655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790711942.986080:0:22655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1790711942.986092:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1790711942.991028:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.991156:0:22624:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867118848 00000100:00100000:0.0:1790711942.991170:0:22624:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867118848 00000100:00100000:0.0:1790711942.991261:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 13 00000100:00100000:0.0:1790711942.991273:0:22624:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+18:18816:x1877696867118848:12345-192.168.203.6@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790711942.992987:0:22624:0:(mdd_object.c:4180:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790711942.993048:0:22624:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:0.0:1790711942.993131:0:22624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e124d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.993176:0:22624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e124d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.993189:0:22624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e124d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.993198:0:22624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e124d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.993204:0:22624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e124d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.993211:0:22624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e124d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.993249:0:22624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790711942.993416:0:22610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790711942.993425:0:22610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e124d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.993432:0:22610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7a00 already unused, calling callback (ffffffffc0c13ac0) 00010000:00010000:3.0:1790711942.993437:0:22610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e124d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.993447:0:22610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e124d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.993462:0:22610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9dac82435a00) 00010000:00010000:3.0:1790711942.993465:0:22610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790711942.993470:0:22610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e124d lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.993475:0:22610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7a00/0xcf3cf816241e124d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790711942.993492:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711942.993494:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790711942.993496:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711942.994797:0:22624:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+20:18816:x1877696867118848:12345-192.168.203.6@tcp:35:lhsmtool_posix.0 Request processed in 3511us (3768us total) trans 12884901926 rc 0/0 00000100:00100000:0.0:1790711942.994814:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 13 00000020:00080000:0.0:1790711942.994824:0:22624:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790711942.994987:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711942.995635:0:25210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867118976 00000100:00100000:0.0:1790711942.995647:0:25210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867118976 00000100:00100000:0.0:1790711942.995710:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 31 00000100:00100000:0.0:1790711942.995720:0:25210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+7:18814:x1877696867118976:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:0.0:1790711942.995743:0:25210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711942.995768:0:25210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1254 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa737 expref: -99 pid: 25210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790711942.995798:0:25210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6abc1885, atime: 0x6abc1883, ctime: 0x6abc1885, blocks: 0x0 00010000:00010000:0.0:1790711942.995840:0:25210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=709s v=(0 0) 00010000:00010000:0.0:1790711942.995846:0:25210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790711942.995857:0:25210:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1254 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa737 expref: 8 pid: 25210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.995875:0:25210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb430768/0xcf3cf816241e1254 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa737 expref: 8 pid: 25210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711942.995889:0:25210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7c00, rc 0) 00000100:00100000:0.0:1790711942.995969:0:25210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+8:18814:x1877696867118976:12345-192.168.203.6@tcp:101:bash.0 Request processed in 250us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711942.995976:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 31 00000100:00100000:2.0:1790711943.000432:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711943.000692:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867119104 00000100:00100000:0.0:1790711943.000706:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867119104 00000100:00100000:0.0:1790711943.000794:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 71 00000100:00100000:0.0:1790711943.000805:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+20:18814:x1877696867119104:12345-192.168.203.6@tcp:101:bash.0 00010000:00010000:0.0:1790711943.000836:0:24457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790711943.000864:0:24457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e125b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa73e expref: -99 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.000911:0:24457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1262 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.000927:0:24457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1262 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.000939:0:24457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1262 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.001112:0:24457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e125b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa73e expref: 22 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.001134:0:24457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7400/0xcf3cf816241e1262 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa73e expref: 21 pid: 24457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.001144:0:24457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711943.001148:0:24457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790711943.001152:0:24457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac9bef7400, rc 0) 00000100:00100000:0.0:1790711943.001402:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+21:18814:x1877696867119104:12345-192.168.203.6@tcp:101:bash.0 Request processed in 597us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711943.001410:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 71 00000100:00080000:2.0:1790711943.001662:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790711943.009934:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711943.010259:0:22625:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867119360 00000100:00100000:3.0:1790711943.010273:0:22625:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867119360 00000100:00100000:3.0:1790711943.010363:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 14 00000100:00100000:3.0:1790711943.010376:0:22625:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+21:18814:x1877696867119360:12345-192.168.203.6@tcp:35:bash.0 00000001:00080000:3.0:1790711943.010767:0:22625:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:3.0:1790711943.010874:0:22625:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:3.0:1790711943.011260:0:22625:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+24:18814:x1877696867119360:12345-192.168.203.6@tcp:35:bash.0 Request processed in 883us (1335us total) trans 12884901929 rc 0/0 00000100:00100000:3.0:1790711943.011271:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 14 00000020:00080000:3.0:1790711943.011278:0:22625:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1790711943.144689:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:2.0:1790711943.146503:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867119616 00000100:00100000:2.0:1790711943.146524:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867119616 00000100:00100000:2.0:1790711943.146701:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 72 00000100:00100000:2.0:1790711943.146724:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+24:18826:x1877696867119616:12345-192.168.203.6@tcp:101:lfs.0 00010000:00010000:2.0:1790711943.146758:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790711943.146784:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ece00/0xcf3cf816241e1269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x80fa4a8768ffa745 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790711943.146917:0:22622:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790711943.147047:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ece00/0xcf3cf816241e1269 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa745 expref: 26 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711943.147064:0:22622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9dab8300dc00) 00010000:00010000:2.0:1790711943.147093:0:22622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790711943.147101:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac994ece00/0xcf3cf816241e1269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.6@tcp remote: 0x80fa4a8768ffa745 expref: 26 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790711943.147117:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9dac994ece00, rc 0) 00000100:00100000:2.0:1790711943.147214:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+25:18826:x1877696867119616:12345-192.168.203.6@tcp:101:lfs.0 Request processed in 493us (2541us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1790711943.147223:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 72 00000100:00100000:3.0:1790711943.154900:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711943.155022:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867119744 00000100:00100000:0.0:1790711943.155036:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867119744 00000100:00100000:0.0:1790711943.155113:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 73 00000100:00100000:0.0:1790711943.155124:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab830bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+25:18826:x1877696867119744:12345-192.168.203.6@tcp:34:lfs.0 00010000:00010000:0.0:1790711943.155229:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e1277 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155266:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e1277 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155278:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e1277 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155296:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e127e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155324:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e127e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155330:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e127e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155444:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1285 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155454:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1285 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155460:0:22623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1285 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790711943.155518:0:22623:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1285 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155533:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e1277 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155580:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e1277 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155588:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e1277 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155595:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef6200 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:0.0:1790711943.155600:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e1277 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155609:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e1277 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155633:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9dac82435600) 00010000:00010000:0.0:1790711943.155637:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790711943.155642:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e1277 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155649:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6200/0xcf3cf816241e1277 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155664:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e127e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155670:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e127e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155675:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e127e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155681:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef6000 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:0.0:1790711943.155684:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e127e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155689:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e127e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155695:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9dab8222ce00) 00010000:00010000:0.0:1790711943.155697:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790711943.155700:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e127e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155705:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef6000/0xcf3cf816241e127e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155728:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1285 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155734:0:22623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1285 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155740:0:22623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1285 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155745:0:22623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9dac9bef7600 already unused, calling callback (ffffffffc183d4f0) 00010000:00010000:0.0:1790711943.155748:0:22623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1285 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155753:0:22623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1285 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155759:0:22623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9dab8300d800) 00010000:00010000:0.0:1790711943.155762:0:22623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790711943.155764:0:22623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1285 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790711943.155769:0:22623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9dac9bef7600/0xcf3cf816241e1285 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790711943.155864:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab830bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e97fa3d-af78-4872-a8a1-4a103992cb38+25:18826:x1877696867119744:12345-192.168.203.6@tcp:34:lfs.0 Request processed in 740us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711943.155872:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 73 00000100:00100000:3.0:1790711943.162079:0:3600:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711943.162278:0:22624:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867120000 00000100:00100000:0.0:1790711943.162297:0:22624:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867120000 00000100:00100000:0.0:1790711943.162370:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 15 00000100:00100000:0.0:1790711943.162406:0:22624:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+25:18826:x1877696867120000:12345-192.168.203.6@tcp:35:lfs.0 00000100:00100000:0.0:1790711943.162732:0:22624:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+26:18826:x1877696867120000:12345-192.168.203.6@tcp:35:lfs.0 Request processed in 327us (666us total) trans 12884901931 rc 0/0 00000100:00100000:0.0:1790711943.162741:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 15 00010000:00010000:2.0:1790711943.258849:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790711943.514813:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790711943.514844:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879811840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790711943.514935:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711943.515004:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879811840 00000100:00100000:1.0:1790711943.515013:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879811840 00000100:00100000:1.0:1790711943.515079:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790711943.515091:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879811840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790711943.515304:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1790711943.515825:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1877696879811840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 637us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711943.515837:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790711943.515923:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879811840:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1790711943.517817:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790711943.518188:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879811968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790711943.518312:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711943.518396:0:24132:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879811968 00000100:00100000:1.0:1790711943.518403:0:24132:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879811968 00000100:00100000:1.0:1790711943.518457:0:24132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790711943.518465:0:24132:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3608:x1877696879811968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790711943.518518:0:24132:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790711943.521693:0:24132:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc448700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3608:x1877696879811968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3213us (3366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711943.521713:0:24132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790711943.521837:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3608:1877696879811968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790711943.525803:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879812096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790711943.525925:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711943.526231:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879812096 00000100:00100000:1.0:1790711943.526252:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879812096 00000100:00100000:1.0:1790711943.526333:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790711943.526344:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879812096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790711943.526375:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1790711943.526434:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1877696879812096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711943.526441:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790711943.526675:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3609:1877696879812096:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790711943.526703:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790711943.528406:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790711943.528429:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790711943.528432:0:3609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab8398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879812224:0@lo:400:kworker.0 00000100:00100000:1.0:1790711943.528453:0:3608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dacbc448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879812352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790711943.528537:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790711943.528538:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711943.528647:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879812224 00000100:00100000:2.0:1790711943.528655:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879812224 00000100:00100000:2.0:1790711943.528713:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790711943.528734:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790711943.528741:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3609:x1877696879812224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.528749:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879812480:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.528798:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790711943.528826:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc8ed208-5edc-469a-a5f9-449dbe325e20+24:3609:x1877696879812224:12345-0@lo:400:kworker.0 Request processed in 100us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711943.528833:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790711943.528871:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879812480 00000100:00100000:2.0:1790711943.528875:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879812480 00000100:00100000:2.0:1790711943.528918:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790711943.528925:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879812480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.529059:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790711943.529071:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1877696879812608:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.529108:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711943.530499:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879812736:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.530573:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711943.530611:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879812736 00000100:00100000:3.0:1790711943.530619:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879812736 00000100:00100000:3.0:1790711943.530660:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790711943.530669:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879812736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.530727:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879812736:12345-0@lo:400:kworker.0 Request processed in 58us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711943.530735:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790711943.530776:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879812736:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.530836:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879812864:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.530866:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711943.530911:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790711943.530931:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877696879812992:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.530958:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711943.530997:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790711943.531003:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879813120:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531026:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711943.531064:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1877696879813248:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531087:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711943.531127:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1877696879813376:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531149:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711943.531179:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790711943.531184:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1877696879813504:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531208:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790711943.531248:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879812608 00000100:00100000:3.0:1790711943.531253:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879812608 00000100:00100000:3.0:1790711943.531280:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879812992 00000100:00100000:3.0:1790711943.531282:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879812992 00000100:00100000:3.0:1790711943.531293:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879813120 00000100:00100000:3.0:1790711943.531295:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879813120 00000100:00080000:3.0:1790711943.531317:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790711943.531331:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879813248 00000100:00100000:3.0:1790711943.531334:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879813248 00000100:00080000:3.0:1790711943.531345:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790711943.531355:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879813376 00000100:00100000:3.0:1790711943.531358:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879813376 00000100:00080000:3.0:1790711943.531367:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790711943.531388:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879813504 00000100:00100000:3.0:1790711943.531391:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879813504 00000100:00080000:3.0:1790711943.531463:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790711943.531479:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790711943.531486:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1877696879812608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531530:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3610:x1877696879812608:12345-0@lo:400:kworker.0 Request processed in 44us (2422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711943.531537:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790711943.531589:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3610:1877696879812608:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531612:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790711943.531619:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877696879812992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531658:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877696879812992:12345-0@lo:400:kworker.0 Request processed in 40us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711943.531665:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790711943.531685:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877696879812992:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531702:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790711943.531709:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1877696879813120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531739:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3610:x1877696879813120:12345-0@lo:400:kworker.0 Request processed in 32us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711943.531746:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790711943.531766:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3610:1877696879813120:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531780:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790711943.531786:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1877696879813248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531836:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3610:x1877696879813248:12345-0@lo:400:kworker.0 Request processed in 49us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711943.531848:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1790711943.531875:0:3610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83a4b100 x1877696879813248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711943.531885:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3610:1877696879813248:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531902:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790711943.531908:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877696879813376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531941:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877696879813376:12345-0@lo:400:kworker.0 Request processed in 34us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711943.531948:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790711943.531970:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3607:1877696879813376:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.531985:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790711943.531991:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877696879813504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.532023:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877696879813504:12345-0@lo:400:kworker.0 Request processed in 32us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711943.532030:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1790711943.532051:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9dab83a48a80 x1877696879813504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790711959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790711943.532060:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3607:1877696879813504:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.532123:0:3609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab8398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bc8ed208-5edc-469a-a5f9-449dbe325e20:3609:1877696879812224:0@lo:400:kworker.0 00000100:00100000:3.0:1790711943.532167:0:24130:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879812864 00000100:00100000:3.0:1790711943.532172:0:24130:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879812864 00000100:00100000:3.0:1790711943.532210:0:24130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790711943.532216:0:24130:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877696879812864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790711943.532387:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877696879812480:12345-0@lo:400:kworker.0 Request processed in 3452us (3580us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711943.532400:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790711943.532502:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3607:1877696879812480:0@lo:400:kworker.0 00000100:00100000:1.0:1790711943.532529:0:24131:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879812352 00000100:00100000:1.0:1790711943.532536:0:24131:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879812352 00000100:00100000:1.0:1790711943.532600:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1790711943.532613:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790711943.532614:0:24131:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1877696879812352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790711943.532640:0:24131:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1790711943.533023:0:24130:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83a48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3607:x1877696879812864:12345-0@lo:400:kworker.0 Request processed in 805us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711943.533033:0:24130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790711943.533130:0:24131:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1877696879812352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 522us (4604us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711943.533138:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790711943.533234:0:3608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dacbc448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3608:1877696879812352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790711943.534124:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3607:1877696879812864:0@lo:400:kworker.0 00010000:00010000:3.0:1790711944.285811:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790711944.347623:0:23375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790711944.539948:0:3610:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790711944.539974:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879813632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790711944.540048:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711944.540145:0:23610:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879813632 00000100:00100000:0.0:1790711944.540153:0:23610:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879813632 00000100:00100000:0.0:1790711944.540205:0:23610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790711944.540214:0:23610:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879813632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790711944.540258:0:23610:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1790711944.540313:0:23610:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3610:x1877696879813632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711944.540320:0:23610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790711944.540405:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab81cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3610:1877696879813632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790711944.540772:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9dab83b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879813760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790711944.540803:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790711944.540980:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696879813760 00000100:00100000:0.0:1790711944.540984:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696879813760 00000100:00100000:0.0:1790711944.541019:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790711944.541026:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacbc449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879813760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790711944.541047:0:22627:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790711944.541081:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacbc449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3610:x1877696879813760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711944.541087:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790711944.541263:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9dab83b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3610:1877696879813760:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1790711945.027144:0:25706:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1790711945.306743:0:22609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790711945.356398:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711945.356448:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711945.356481:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711945.356519:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711945.356617:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711945.356634:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867120384 00000100:00100000:0.0:1790711945.356647:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711945.356652:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867120384 00000100:00100000:0.0:1790711945.356673:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:0.0:1790711945.356706:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711945.356744:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867120896 00000100:00100000:3.0:1790711945.356750:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867120896 00000100:00100000:0.0:1790711945.356758:0:3601:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711945.356784:0:24457:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867120256 00000100:00100000:3.0:1790711945.356789:0:24457:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867120256 00000100:00100000:0.0:1790711945.356803:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867120768 00000100:00100000:3.0:1790711945.356821:0:24457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 64 00000100:00100000:0.0:1790711945.356826:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867120768 00000100:00100000:3.0:1790711945.356835:0:24457:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2409:x1877696867120384:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1790711945.356885:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00100000:0.0:1790711945.356898:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:201f8768-6771-4009-8040-f3ce7014ecea+5:2409:x1877696867120896:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:3.0:1790711945.356969:0:24457:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2409:x1877696867120384:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 134us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711945.356977:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:201f8768-6771-4009-8040-f3ce7014ecea+5:2409:x1877696867120896:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 76us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711945.356987:0:24457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 64 00000100:00100000:1.0:1790711945.357056:0:25210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867120640 00000100:00100000:1.0:1790711945.357063:0:25210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867120640 00000100:00100000:1.0:1790711945.357090:0:25210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867121152 00000100:00100000:1.0:1790711945.357092:0:25210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867121152 00000100:00100000:1.0:1790711945.357103:0:25210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867120512 00000100:00100000:1.0:1790711945.357105:0:25210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867120512 00000100:00100000:1.0:1790711945.357114:0:25210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867121024 00000100:00100000:1.0:1790711945.357116:0:25210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867121024 00000100:00100000:1.0:1790711945.357130:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:1.0:1790711945.357137:0:25210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab81ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2409:x1877696867120640:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1790711945.357167:0:25210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab81ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+5:2409:x1877696867120640:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 31us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711945.357174:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 23 00000100:00100000:1.0:1790711945.357190:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:1.0:1790711945.357196:0:25210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:201f8768-6771-4009-8040-f3ce7014ecea+5:2409:x1877696867121152:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1790711945.357309:0:25210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:201f8768-6771-4009-8040-f3ce7014ecea+5:2409:x1877696867121152:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 112us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711945.357316:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 24 00000100:00100000:1.0:1790711945.357328:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 25 00000100:00100000:1.0:1790711945.357335:0:25210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+8:2409:x1877696867120512:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1790711945.357360:0:25210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+8:2409:x1877696867120512:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 26us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711945.357366:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 25 00000100:00100000:1.0:1790711945.357377:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 26 00000100:00100000:1.0:1790711945.357382:0:25210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:201f8768-6771-4009-8040-f3ce7014ecea+5:2409:x1877696867121024:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:1.0:1790711945.357415:0:25210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:201f8768-6771-4009-8040-f3ce7014ecea+5:2409:x1877696867121024:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 33us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1790711945.357422:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 26 00000100:00100000:2.0:1790711945.357919:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867120128 00000100:00100000:2.0:1790711945.357926:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867120128 00000100:00100000:2.0:1790711945.357971:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 166 00000100:00100000:2.0:1790711945.357979:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dacb52d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:2409:x1877696867120128:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:2.0:1790711945.358010:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dacb52d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8a411b8-5cf6-4a02-9e5d-e280698795de+13:2409:x1877696867120128:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 32us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790711945.358017:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 166 00000100:00100000:0.0:1790711945.358349:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 65 00000100:00080000:0.0:1790711945.358391:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790711945.358396:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790711945.358399:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790711945.358402:0:22616:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790711945.358418:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00100000:0.0:1790711945.358427:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+26:2409:x1877696867120256:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1790711945.358461:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e97fa3d-af78-4872-a8a1-4a103992cb38+26:2409:x1877696867120256:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 36us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711945.358467:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 66 00000100:00100000:0.0:1790711945.358479:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 67 00000100:00100000:0.0:1790711945.358486:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab82f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:201f8768-6771-4009-8040-f3ce7014ecea+6:2409:x1877696867120768:12345-192.168.203.6@tcp:400:kworker.0 00000100:00100000:0.0:1790711945.358511:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab82f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:201f8768-6771-4009-8040-f3ce7014ecea+6:2409:x1877696867120768:12345-192.168.203.6@tcp:400:kworker.0 Request processed in 25us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1790711945.358517:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 67 00010000:00010000:3.0:1790711946.330709:0:22610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790711946.364303:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711946.364345:0:3602:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.6@tcp (source: 12345-192.168.203.6@tcp) 00000100:00100000:3.0:1790711946.364375:0:25210:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867121408 00000100:00100000:3.0:1790711946.364385:0:25210:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867121408 00000100:00100000:3.0:1790711946.364453:0:25210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 32 00000100:00100000:3.0:1790711946.364463:0:25210:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+8:2410:x1877696867121408:12345-192.168.203.6@tcp:16:kworker.0 00000100:00100000:3.0:1790711946.364605:0:25210:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e97fa3d-af78-4872-a8a1-4a103992cb38+8:2410:x1877696867121408:12345-192.168.203.6@tcp:16:kworker.0 Request processed in 143us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1790711946.364613:0:25210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 32 00000100:00100000:0.0:1790711946.367497:0:24133:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877696867121280 00000100:00100000:0.0:1790711946.367511:0:24133:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877696867121280 00002000:00100000:0.0:1790711946.367610:0:24133:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9dab83b69f80 x1877696867121280/t0(0) o4->6e97fa3d-af78-4872-a8a1-4a103992cb38@192.168.203.6@tcp:692/0 lens 504/0 e 0 to 0 dl 1790711957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1790711946.367623:0:24133:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dab83b69f80 with x1877696867121280 ext(0->8) 00002000:00010000:0.0:1790711946.367630:0:24133:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dab83b69f80 00000100:00100000:0.0:1790711946.367659:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.6@tcp, seq: 0 00000100:00100000:0.0:1790711946.367668:0:24133:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9dab83b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+8:2410:x1877696867121280:12345-192.168.203.6@tcp:4:bash.0 00000100:00100000:1.0:1790711946.389918:0:24133:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9dab83b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e97fa3d-af78-4872-a8a1-4a103992cb38+10:2410:x1877696867121280:12345-192.168.203.6@tcp:4:bash.0 Request processed in 22242us (25615us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1790711946.389939:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.6@tcp, seq: 0 00002000:00100000:1.0:1790711946.389951:0:24133:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9dab83b69f80 x1877696867121280/t12884901895(0) o4->6e97fa3d-af78-4872-a8a1-4a103992cb38@192.168.203.6@tcp:692/0 lens 504/448 e 0 to 0 dl 1790711957 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1790711946.389962:0:24133:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9dab83b69f80 with x1877696867121280 ext(0->8) 00002000:00010000:1.0:1790711946.389969:0:24133:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9dab83b69f80 Debug log: 14605 lines, 14605 kept, 0 dropped, 0 bad.