00010000:00010000:2.0F:1788837934.396499:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1788837934.526904:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837934.526937:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037057152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837934.527011:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837934.527436:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037057152 00000100:00100000:3.0:1788837934.527445:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037057152 00000100:00100000:3.0:1788837934.527505:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788837934.527514:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037057152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837934.527543:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788837934.527590:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037057152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837934.527597:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788837934.527989:0:3651:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788837934.528002:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff889b00cb2680, transno 8589934596 00000004:00080000:3.0:1788837934.528012:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788837934.528058:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037057152:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837934.528213:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0F:1788837935.225108:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788837935.225131:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837935.225152:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788837935.225161:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788837935.420382:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837935.545001:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837935.545027:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037057280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837935.545121:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837935.545182:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037057280 00000100:00100000:2.0:1788837935.545189:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037057280 00000100:00100000:2.0:1788837935.545243:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788837935.545252:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037057280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837935.545273:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788837935.545327:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037057280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837935.545334:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788837935.545355:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837935.545390:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037057280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837935.546599:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037057408:0@lo:400:kworker.0 00000100:00100000:3.0:1788837935.546649:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837935.546681:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037057920:0@lo:400:kworker.0 00000100:00100000:3.0:1788837935.546707:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837935.546729:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837935.546735:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037057536:0@lo:400:kworker.0 00000100:00100000:3.0:1788837935.546758:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837935.546869:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037057792:0@lo:400:kworker.0 00000100:00100000:3.0:1788837935.546900:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837935.546920:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837935.546944:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037057664:0@lo:400:kworker.0 00000100:00100000:3.0:1788837935.546971:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837935.547001:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037057408 00000100:00100000:3.0:1788837935.547007:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037057408 00000100:00100000:3.0:1788837935.547047:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788837935.547056:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3648:x1875732037057408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837935.547227:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037057792 00000100:00100000:1.0:1788837935.547232:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037057792 00000100:00100000:1.0:1788837935.547264:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037057664 00000100:00100000:1.0:1788837935.547267:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037057664 00000100:00100000:1.0:1788837935.547360:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788837935.547368:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037057792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837935.547406:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037057792:12345-0@lo:400:kworker.0 Request processed in 39us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837935.547413:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788837935.547428:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788837935.547435:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037057664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837935.547461:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037057664:12345-0@lo:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837935.547467:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788837935.547487:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732037058432:0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.547736:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037058048:0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.548495:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837935.548541:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732037058560:0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.548568:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837935.548593:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037059072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837935.548617:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837935.548636:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837935.548641:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037058944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837935.548662:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1788837935.548971:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037057536 00000100:00100000:0.0:1788837935.548987:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037057536 00000100:00100000:0.0:1788837935.549024:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037058048 00000100:00100000:0.0:1788837935.549027:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037058048 00000100:00100000:0.0:1788837935.549043:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788837935.549051:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037057536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837935.549121:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037057536:12345-0@lo:400:kworker.0 Request processed in 70us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837935.549128:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788837935.549144:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788837935.549151:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037058048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837935.549185:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037058048:12345-0@lo:400:kworker.0 Request processed in 35us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837935.549192:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788837935.549529:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037057920 00000100:00100000:2.0:1788837935.549535:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037057920 00000100:00100000:2.0:1788837935.549565:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037058560 00000100:00100000:2.0:1788837935.549568:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037058560 00000100:00100000:2.0:1788837935.549592:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788837935.549606:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037057920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.549643:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037057920:12345-0@lo:400:kworker.0 Request processed in 38us (2935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837935.549649:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788837935.549661:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788837935.549667:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732037058560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.549694:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732037058560:12345-0@lo:400:kworker.0 Request processed in 27us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837935.549700:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788837935.549720:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037059072 00000100:00100000:2.0:1788837935.549724:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037059072 00000100:00100000:2.0:1788837935.549737:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037058944 00000100:00100000:2.0:1788837935.549739:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037058944 00000100:00100000:2.0:1788837935.549750:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788837935.549755:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037059072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837935.549907:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788837935.549942:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037059072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837935.549948:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788837935.549959:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788837935.549964:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037058944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837935.549972:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788837935.549993:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037058944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837935.549999:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788837935.550014:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837935.550023:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837935.550041:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037058176:0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.550151:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837935.550179:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037058688:0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.550201:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837935.550220:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788837935.550227:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037058304:0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.550246:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837935.550260:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037058816:0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.550279:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837935.550299:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037058176 00000100:00100000:2.0:1788837935.550303:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037058176 00000100:00100000:2.0:1788837935.550329:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788837935.550335:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037058176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.550367:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037058176:12345-0@lo:400:kworker.0 Request processed in 33us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837935.550372:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788837935.550388:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037058688 00000100:00100000:2.0:1788837935.550391:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037058688 00000100:00100000:2.0:1788837935.550410:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037058304 00000100:00100000:2.0:1788837935.550413:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037058304 00000100:00100000:2.0:1788837935.550421:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037058816 00000100:00100000:2.0:1788837935.550424:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037058816 00000100:00100000:2.0:1788837935.550435:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788837935.550440:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037058688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.550468:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037058688:12345-0@lo:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837935.550483:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788837935.550496:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788837935.554375:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037058304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.554568:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037058304:12345-0@lo:400:kworker.0 Request processed in 3997us (4250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837935.554580:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788837935.554618:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788837935.554632:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732037058816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.554694:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732037058816:12345-0@lo:400:kworker.0 Request processed in 67us (4413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837935.554701:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788837935.554729:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837935.554733:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837935.554941:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037058944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837935.554963:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037059072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837935.554977:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037058048:0@lo:400:kworker.0 00010000:00080000:2.0:1788837935.554991:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889b00d17100 x1875732037058560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837935.555001:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732037058560:0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.555050:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037058304:0@lo:400:kworker.0 00010000:00080000:2.0:1788837935.555061:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3d9d500 x1875732037058816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837935.555071:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037058816:0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.555173:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037058176:0@lo:400:kworker.0 00000100:00100000:2.0:1788837935.555183:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037058688:0@lo:400:kworker.0 00000100:00100000:3.0:1788837935.556950:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3648:x1875732037057408:12345-0@lo:400:kworker.0 Request processed in 9886us (10291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837935.556963:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788837935.557182:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037057664:0@lo:400:kworker.0 00000100:00100000:3.0:1788837935.557205:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037057792:0@lo:400:kworker.0 00000100:00100000:1.0:1788837935.557357:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837935.557396:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037057536:0@lo:400:kworker.0 00000100:00100000:1.0:1788837935.557405:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037057408:0@lo:400:kworker.0 00000100:00100000:1.0:1788837935.557416:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037057920:0@lo:400:kworker.0 00000100:00100000:3.0:1788837935.557606:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037058432 00000100:00100000:3.0:1788837935.557614:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037058432 00000100:00100000:3.0:1788837935.557671:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788837935.557680:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732037058432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837935.557730:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732037058432:12345-0@lo:400:kworker.0 Request processed in 51us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837935.557736:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788837935.558807:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837935.558852:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732037058432:0@lo:400:kworker.0 00000100:00100000:1.0:1788837936.058874:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837936.058906:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037059200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837936.058986:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837936.059033:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037059200 00000100:00100000:1.0:1788837936.059041:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037059200 00000100:00100000:1.0:1788837936.059104:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837936.059113:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037059200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837936.059164:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788837936.059219:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037059200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837936.059226:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837936.059280:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037059200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837936.061030:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837936.061049:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037059328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837936.061113:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837936.061231:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037059328 00000100:00100000:1.0:1788837936.061238:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037059328 00000100:00100000:1.0:1788837936.061278:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837936.061286:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037059328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837936.061313:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788837936.061352:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037059328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837936.061359:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788837936.061758:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037059328:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1788837936.061869:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1788837936.061882:0:17180:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8899c2298600 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:1.0:1788837936.061887:0:17180:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889af7618800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8899c2298a80 00000020:00080000:1.0:1788837936.061890:0:17180:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889af7618100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff889b00c55200 00000020:00080000:1.0:1788837936.061914:0:17240:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:1.0:1788837936.061972:0:17240:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788837936.062019:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837936.062031:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837936.062037:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837936.062043:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac7c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837936.062048:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837936.062055:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837936.062081:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:2.0:1788837936.062084:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837936.062088:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837936.062095:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837936.442911:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837936.929028:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837936.929159:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012868992 00000100:00100000:3.0:1788837936.929171:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012868992 00000100:00100000:3.0:1788837936.929247:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:3.0:1788837936.929268:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+13:15565:x1875732012868992:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1788837936.929427:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837936.929530:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+13:15565:x1875732012868992:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 Request processed in 273us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837936.929539:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:2.0:1788837936.936901:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837936.937073:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012869120 00000100:00100000:3.0:1788837936.937084:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012869120 00000100:00080000:1.0:1788837936.937205:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837936.937266:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:3.0:1788837936.937279:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+5:15565:x1875732012869120:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788837936.937394:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+5:15565:x1875732012869120:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 Request processed in 118us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837936.937401:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:2.0:1788837936.941479:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837936.941638:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012869376 00000100:00100000:1.0:1788837936.941648:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012869376 00000100:00100000:1.0:1788837936.941730:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:1.0:1788837936.941740:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067bdd78-c556-4265-9b97-e4112a37245c+13:15565:x1875732012869376:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788837936.941984:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067bdd78-c556-4265-9b97-e4112a37245c+14:15565:x1875732012869376:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 245us (515us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788837936.941992:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00010000:00010000:2.0:1788837937.465108:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837937.654184:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837937.654233:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837937.654274:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837937.654316:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837937.654346:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837937.654365:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837937.654382:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837937.654404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837937.654425:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837937.654453:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012869760 00000100:00100000:0.0:1788837937.654462:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012869760 00000100:00100000:0.0:1788837937.654507:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012870144 00000100:00100000:0.0:1788837937.654510:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012870144 00000100:00100000:0.0:1788837937.654531:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012869632 00000100:00100000:0.0:1788837937.654534:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012869632 00000100:00100000:0.0:1788837937.654562:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012870272 00000100:00100000:0.0:1788837937.654565:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012870272 00000100:00100000:0.0:1788837937.654583:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 81 00000100:00100000:0.0:1788837937.654593:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012869760:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837937.654668:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012869760:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 76us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837937.654676:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 81 00000100:00100000:0.0:1788837937.654692:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 82 00000100:00100000:0.0:1788837937.654699:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2394:x1875732012870144:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837937.654723:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2394:x1875732012870144:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837937.654729:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 82 00000100:00100000:0.0:1788837937.654741:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 83 00000100:00100000:0.0:1788837937.654746:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+14:2394:x1875732012869632:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837937.654771:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+14:2394:x1875732012869632:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837937.654810:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 83 00000100:00100000:0.0:1788837937.654820:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 84 00000100:00100000:0.0:1788837937.654827:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2394:x1875732012870272:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837937.654851:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2394:x1875732012870272:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837937.654857:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 84 00000100:00100000:0.0:1788837937.654874:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012869888 00000100:00100000:0.0:1788837937.654877:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012869888 00000100:00100000:0.0:1788837937.654895:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012870016 00000100:00100000:0.0:1788837937.654903:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012870016 00000100:00100000:0.0:1788837937.654916:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012870400 00000100:00100000:0.0:1788837937.654918:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012870400 00000100:00100000:0.0:1788837937.654928:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012870528 00000100:00100000:0.0:1788837937.654931:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012870528 00000100:00100000:0.0:1788837937.654943:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:0.0:1788837937.654949:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012869888:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837937.654972:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012869888:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837937.654978:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:0.0:1788837937.654988:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:0.0:1788837937.654993:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+5:2392:x1875732012870016:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:0.0:1788837937.655010:0:18707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af05f3 00000100:00080000:0.0:1788837937.655024:0:18707:0:(import.c:65:import_set_state_nolock()) ffff889ac6be7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837937.655072:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788837937.655192:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+2:2392:x1875732012870016:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 198us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837937.655198:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:0.0:1788837937.655209:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788837937.655216:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2392:x1875732012870400:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:0.0:1788837937.655226:0:18707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af062b 00000100:00080000:0.0:1788837937.655233:0:18707:0:(import.c:65:import_set_state_nolock()) ffff889affb4c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837937.655253:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788837937.655316:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+2:2392:x1875732012870400:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 100us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837937.655322:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788837937.655343:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:0.0:1788837937.655350:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2392:x1875732012870528:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:0.0:1788837937.655361:0:18707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0632 00000100:00080000:0.0:1788837937.655367:0:18707:0:(import.c:65:import_set_state_nolock()) ffff889ae7f51000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837937.655384:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788837937.655432:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+2:2392:x1875732012870528:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 83us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837937.655439:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00010000:00010000:3.0:1788837937.656064:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837937.656141:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012869504 00000100:00100000:2.0:1788837937.656148:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012869504 00000100:00100000:2.0:1788837937.656188:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 171 00000100:00100000:2.0:1788837937.656202:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2394:x1875732012869504:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837937.656246:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2394:x1875732012869504:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 50us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837937.656253:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 171 00010000:00010000:2.0:1788837937.656356:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837937.656437:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837937.656442:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837937.656445:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837937.656447:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837937.656454:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837938.494245:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837939.515053:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837939.641131:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037059456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837939.641219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837939.641467:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037059456 00000100:00100000:3.0:1788837939.641475:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037059456 00000100:00100000:3.0:1788837939.641549:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837939.641558:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037059456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837939.641587:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788837939.641643:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037059456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837939.641651:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788837939.642638:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837939.642870:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037059456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788837940.539636:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788837940.617017:0:20577:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 23:25:39 (1788837939) 00000100:00100000:2.0:1788837940.665109:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037059584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837940.665184:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837940.665282:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037059584 00000100:00100000:2.0:1788837940.665292:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037059584 00000100:00100000:2.0:1788837940.665353:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788837940.665362:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037059584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837940.665387:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788837940.665431:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037059584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837940.665438:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788837940.665924:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037059584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837940.666525:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037059712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837940.666570:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837940.669877:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037059712 00000100:00100000:0.0:1788837940.669889:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037059712 00000100:00100000:0.0:1788837940.669955:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788837940.669966:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037059712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837940.670032:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788837940.670160:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037059968:0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.670219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837940.670270:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837940.670277:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037060096:0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.670305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788837940.670333:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837940.670337:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837940.670349:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037059840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837940.670394:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837940.670408:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837940.670415:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037060224:0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.670438:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837940.670466:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037059968 00000100:00100000:1.0:1788837940.670470:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037059968 00000100:00100000:1.0:1788837940.670503:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788837940.670510:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3648:x1875732037059968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.670547:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3648:x1875732037059968:12345-0@lo:400:kworker.0 Request processed in 37us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837940.670832:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788837940.670869:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037060096 00000100:00100000:1.0:1788837940.670874:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037060096 00000100:00100000:1.0:1788837940.670901:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837940.670907:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037060096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.671052:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037060096:12345-0@lo:400:kworker.0 Request processed in 143us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837940.671059:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837940.671105:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037060096:0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.671121:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037059968:0@lo:400:kworker.0 00000100:00100000:3.0:1788837940.672331:0:18710:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788837940.672341:0:18710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788837940.672366:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037060608:0@lo:400:kworker.0 00000100:00100000:3.0:1788837940.672413:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837940.672442:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037061120:0@lo:400:kworker.0 00000100:00100000:3.0:1788837940.672463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837940.672484:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788837940.672489:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037060480:0@lo:400:kworker.0 00000100:00100000:3.0:1788837940.672512:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837940.672531:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732037060992:0@lo:400:kworker.0 00000100:00100000:3.0:1788837940.672564:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837940.672592:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037060608 00000100:00100000:3.0:1788837940.672597:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037060608 00000100:00100000:3.0:1788837940.672632:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037061120 00000100:00100000:3.0:1788837940.672635:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037061120 00000100:00100000:3.0:1788837940.672656:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037060992 00000100:00100000:3.0:1788837940.672658:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037060992 00000100:00100000:3.0:1788837940.672675:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788837940.672682:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037060608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837940.672724:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037060608:12345-0@lo:400:kworker.0 Request processed in 43us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837940.672732:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788837940.672746:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788837940.672753:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732037061120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.674589:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788837940.674604:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732037060992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.674674:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732037060992:12345-0@lo:400:kworker.0 Request processed in 74us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837940.674680:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788837940.674715:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837940.674719:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837940.674737:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037060352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.674773:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837940.674821:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732037060864:0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.674843:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837940.674859:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837940.674865:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732037060736:0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.674885:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837940.674903:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037060352 00000100:00100000:1.0:1788837940.674910:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037060352 00000100:00100000:3.0:1788837940.675058:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732037061120:12345-0@lo:400:kworker.0 Request processed in 2303us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837940.675066:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788837940.675080:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037060864 00000100:00100000:3.0:1788837940.675083:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037060864 00000100:00100000:3.0:1788837940.675116:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037060736 00000100:00100000:3.0:1788837940.675119:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037060736 00000100:00100000:3.0:1788837940.675135:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788837940.675140:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732037060864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837940.675176:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732037060864:12345-0@lo:400:kworker.0 Request processed in 36us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837940.675182:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788837940.675193:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788837940.675198:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732037060736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837940.675237:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732037060736:12345-0@lo:400:kworker.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837940.675243:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788837940.675264:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837940.675266:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837940.675294:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732037060992:0@lo:400:kworker.0 00000100:00100000:3.0:1788837940.675309:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037060608:0@lo:400:kworker.0 00010000:00080000:3.0:1788837940.675324:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889affc4d500 x1875732037061120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837940.675335:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037061120:0@lo:400:kworker.0 00000100:00100000:3.0:1788837940.675379:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037060480 00000100:00100000:3.0:1788837940.675383:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037060480 00000100:00100000:3.0:1788837940.675409:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788837940.675415:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037060480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837940.675453:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037060480:12345-0@lo:400:kworker.0 Request processed in 38us (2940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837940.675460:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788837940.675486:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037060480:0@lo:400:kworker.0 00000100:00100000:0.0:1788837940.675734:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037059712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5768us (9161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837940.675743:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788837940.675761:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037059840 00000100:00100000:0.0:1788837940.675764:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037059840 00000100:00100000:0.0:1788837940.675825:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788837940.675832:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037059840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837940.675849:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788837940.675881:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037059840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (5487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837940.675887:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788837940.675905:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037060224 00000100:00100000:0.0:1788837940.675917:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037060224 00000100:00100000:0.0:1788837940.675958:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788837940.675965:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037060224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837940.676012:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037060224:12345-0@lo:400:kworker.0 Request processed in 49us (5573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837940.676018:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788837940.676038:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837940.676377:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732037060736:0@lo:400:kworker.0 00010000:00080000:0.0:1788837940.676392:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4bace00 x1875732037060864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837940.676402:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732037060864:0@lo:400:kworker.0 00000100:00100000:0.0:1788837940.676412:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037060224:0@lo:400:kworker.0 00000100:00100000:0.0:1788837940.676429:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037059840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837940.677966:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788837940.677981:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037060352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837940.678073:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037060352:12345-0@lo:400:kworker.0 Request processed in 98us (3299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837940.678081:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788837940.678131:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037060352:0@lo:400:kworker.0 00000100:00100000:2.0:1788837940.678390:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037059712:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788837941.118515:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788837941.177086:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837941.177112:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037061248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837941.177187:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837941.177368:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037061376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837941.177396:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837941.180389:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037061248 00000100:00100000:1.0:1788837941.180408:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037061248 00000100:00100000:1.0:1788837941.180470:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037061376 00000100:00100000:1.0:1788837941.180473:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037061376 00000100:00100000:1.0:1788837941.180495:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788837941.180505:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037061248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837941.180546:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788837941.180851:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788837941.180861:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037061376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788837941.180881:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788837941.182106:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037061248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1595us (4912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837941.182118:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788837941.184116:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037061376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3247us (6708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837941.184157:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788837941.187310:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037061376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837941.187334:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037061248:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788837941.562002:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788837942.212585:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788837942.212604:0:17180:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:3.0:1788837942.212683:0:17240:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:3.0:1788837942.212697:0:17240:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:1.0:1788837942.588546:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837942.770060:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837942.770156:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837942.770183:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837942.770263:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837942.771549:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012870656 00000100:00100000:0.0:1788837942.771562:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012870656 00000100:00100000:0.0:1788837942.771624:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 173 00000100:00100000:0.0:1788837942.771633:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2394:x1875732012870656:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837942.771721:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2394:x1875732012870656:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 89us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837942.771729:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 173 00000100:00100000:1.0:1788837942.772756:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012870912 00000100:00100000:1.0:1788837942.772766:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012870912 00000100:00100000:1.0:1788837942.772838:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012871168 00000100:00100000:1.0:1788837942.772842:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012871168 00000100:00100000:1.0:1788837942.772858:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012870784 00000100:00100000:1.0:1788837942.772860:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012870784 00000100:00100000:1.0:1788837942.772893:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 91 00000100:00100000:1.0:1788837942.772902:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012870912:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837942.772972:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012870912:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 70us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837942.772979:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 91 00000100:00100000:1.0:1788837942.772997:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 92 00000100:00100000:1.0:1788837942.773003:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2394:x1875732012871168:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837942.773026:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2394:x1875732012871168:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837942.773031:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 92 00000100:00100000:1.0:1788837942.773042:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 93 00000100:00100000:1.0:1788837942.773052:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+13:2394:x1875732012870784:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837942.773073:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+13:2394:x1875732012870784:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 27us (2811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837942.773079:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 93 00000100:00100000:1.0:1788837942.773127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837942.773186:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837942.776490:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012871296 00000100:00100000:1.0:1788837942.776527:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012871296 00000100:00100000:1.0:1788837942.776602:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 94 00000100:00100000:1.0:1788837942.776612:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2394:x1875732012871296:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837942.776693:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2394:x1875732012871296:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 82us (3506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837942.776701:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 94 00000100:00080000:2.0:1788837942.779229:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837942.779239:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837942.779260:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012871040 00000100:00100000:2.0:1788837942.779270:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012871040 00000100:00100000:2.0:1788837942.779370:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:2.0:1788837942.779382:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012871040:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837942.779466:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012871040:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 86us (6338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837942.779473:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00080000:1.0:1788837942.779679:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788837943.227370:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8cd2a6f9-4711-474b-ad66-0a44190716b9 00000020:00000080:1.0:1788837943.227390:0:18703:0:(genops.c:885:class_export_put()) final put ffff889affb4e000/8cd2a6f9-4711-474b-ad66-0a44190716b9 00000020:00000080:0.0:1788837943.227680:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb4e000/8cd2a6f9-4711-474b-ad66-0a44190716b9 for lustre-OST0000 00000020:00000080:0.0:1788837943.227733:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889affb4c000 for lustre-OST0000 00000001:00100000:2.0:1788837943.227998:0:19523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8cd2a6f9-4711-474b-ad66-0a44190716b9 00000020:00000080:2.0:1788837943.228003:0:19523:0:(genops.c:885:class_export_put()) final put ffff889affb48800/8cd2a6f9-4711-474b-ad66-0a44190716b9 00000001:00100000:2.0:1788837943.228025:0:19523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 067bdd78-c556-4265-9b97-e4112a37245c 00000020:00000080:2.0:1788837943.228028:0:19523:0:(genops.c:885:class_export_put()) final put ffff889ac6be7000/067bdd78-c556-4265-9b97-e4112a37245c 00000020:00000080:3.0:1788837943.228082:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb48800/8cd2a6f9-4711-474b-ad66-0a44190716b9 for lustre-OST0001 00000020:00000080:3.0:1788837943.228130:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac6be7000/067bdd78-c556-4265-9b97-e4112a37245c for lustre-OST0001 00000020:00000080:3.0:1788837943.228146:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ae7f51000 for lustre-OST0001 00000020:00000080:3.0:1788837943.228153:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ac6be7800 for lustre-OST0001 00010000:00010000:1.0:1788837943.610340:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837943.905963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837943.906182:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012871552 00000100:00100000:3.0:1788837943.906193:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012871552 00000100:00100000:3.0:1788837943.906264:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:3.0:1788837943.906275:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067bdd78-c556-4265-9b97-e4112a37245c+13:16326:x1875732012871552:12345-192.168.201.3@tcp:35:umount.0 00000001:00080000:3.0:1788837943.906515:0:17204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788837943.906945:0:17204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:3.0:1788837943.907083:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067bdd78-c556-4265-9b97-e4112a37245c+16:16326:x1875732012871552:12345-192.168.201.3@tcp:35:umount.0 Request processed in 807us (1159us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1788837943.907091:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00000020:00080000:3.0:1788837943.907096:0:17204:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788837943.922958:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837943.923003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837943.923045:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837943.923190:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012871680 00000100:00100000:3.0:1788837943.923209:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012871680 00000100:00100000:3.0:1788837943.923264:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012871936 00000100:00100000:3.0:1788837943.923267:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012871936 00000100:00100000:3.0:1788837943.923279:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012871808 00000100:00100000:3.0:1788837943.923281:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012871808 00000100:00100000:3.0:1788837943.923296:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:3.0:1788837943.923305:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7253ef40-cd6d-4a26-9386-e23758a56a4e+15:2396:x1875732012871680:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837943.923323:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837943.923357:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afbea6400/0x57f6d4e926af05c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee03 expref: 15 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.923387:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837943.923436:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7253ef40-cd6d-4a26-9386-e23758a56a4e+14:2396:x1875732012871680:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 132us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837943.923444:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:3.0:1788837943.923462:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:3.0:1788837943.923468:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2396:x1875732012871936:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837943.923477:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837943.923486:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afbea7600/0x57f6d4e926af068d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eeea expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.923495:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837943.923514:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:2396:x1875732012871936:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 46us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837943.923520:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:3.0:1788837943.923562:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:3.0:1788837943.923569:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:2396:x1875732012871808:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837943.923577:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837943.923586:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c9e00/0x57f6d4e926af05d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee34 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.923596:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837943.923613:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:2396:x1875732012871808:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 45us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837943.923620:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:1.0:1788837943.932828:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837943.933126:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012872064 00000100:00100000:0.0:1788837943.933244:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012872064 00000100:00100000:0.0:1788837943.933353:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:0.0:1788837943.933375:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+5:2392:x1875732012872064:12345-192.168.201.3@tcp:9:umount.0 00000020:00000080:0.0:1788837943.933415:0:18707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af05ec 00000100:00080000:0.0:1788837943.933425:0:18707:0:(import.c:65:import_set_state_nolock()) ffff889aded3e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837943.933497:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788837943.933650:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+2:2392:x1875732012872064:12345-192.168.201.3@tcp:9:umount.0 Request processed in 288us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837943.933658:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 35 00010000:00010000:2.0:1788837943.933716:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837943.943589:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837943.943689:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012872960 00000100:00100000:2.0:1788837943.943699:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012872960 00000100:00100000:2.0:1788837943.943761:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:2.0:1788837943.943771:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+16:2392:x1875732012872960:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:2.0:1788837943.943835:0:19205:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af05de 00000020:00010000:2.0:1788837943.943863:0:19205:0:(genops.c:1921:obd_stale_export_put()) Put export ffff889ac84ba000: total 0 00000100:00080000:2.0:1788837943.943868:0:19205:0:(import.c:65:import_set_state_nolock()) ffff889ac84b8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788837943.943910:0:19205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:3.0:1788837943.944170:0:17189:0:(genops.c:1907:obd_stale_export_get()) Get export ffff889ac84ba000: total 0 00010000:00010000:3.0:1788837943.944175:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837943.944241:0:17189:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff889ac84ba000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788837943.944274:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889af8e98900) 00010000:00010000:3.0:1788837943.944277:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837943.944286:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926af06c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eef8 expref: 17 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.944312:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:3.0:1788837943.944315:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788837943.944319:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef5a expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.944331:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:3.0:1788837943.944334:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837943.944337:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af08f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003efa7 expref: 15 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.944350:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1fc00) 00010000:00010000:3.0:1788837943.944352:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837943.944357:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6c00/0x57f6d4e926af0704 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef06 expref: 14 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.944383:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:3.0:1788837943.944386:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837943.944389:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da800/0x57f6d4e926af0893 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef84 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.944405:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff889af8e98f00) 00010000:00010000:3.0:1788837943.944414:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837943.944420:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926af06a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eef1 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.944437:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:3.0:1788837943.944440:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788837943.944444:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0789 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef30 expref: 11 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.944458:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:3.0:1788837943.944460:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837943.944464:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0838 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef6f expref: 10 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837943.944477:0:17189:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff889ac84ba000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1788837943.944491:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837943.944493:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837943.944495:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837943.944880:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+6:2392:x1875732012872960:12345-192.168.201.3@tcp:39:umount.0 Request processed in 1097us (1287us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1788837943.944890:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:2.0:1788837943.952470:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837943.952609:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012873088 00000100:00100000:0.0:1788837943.952620:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012873088 00000100:00100000:0.0:1788837943.952683:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:0.0:1788837943.952693:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+5:2392:x1875732012873088:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:0.0:1788837943.952735:0:17202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af05e5 00000100:00080000:0.0:1788837943.952752:0:17202:0:(import.c:65:import_set_state_nolock()) ffff889aded3e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837943.952843:0:17202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788837943.953294:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+3:2392:x1875732012873088:12345-192.168.201.3@tcp:39:umount.0 Request processed in 602us (835us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788837943.953301:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 68 00010000:00010000:1.0:1788837943.953370:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837944.633194:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837944.761644:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037061504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837944.761729:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837944.761900:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037061504 00000100:00100000:2.0:1788837944.761908:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037061504 00000100:00100000:2.0:1788837944.761981:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788837944.761990:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037061504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837944.762020:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788837944.762083:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037061504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837944.762090:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788837944.762333:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037061504:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837944.762530:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788837945.465031:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788837945.465042:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837945.465078:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788837945.465088:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788837945.657086:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837945.785085:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837945.785119:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037061632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837945.785192:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837945.785323:0:20579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037061632 00000100:00100000:1.0:1788837945.785330:0:20579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037061632 00000100:00100000:1.0:1788837945.785398:0:20579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788837945.785409:0:20579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037061632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837945.785446:0:20579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788837945.785503:0:20579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037061632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.785511:0:20579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837945.785665:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037061632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837945.786006:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037062144:0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.786038:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837945.786059:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037062656:0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.786082:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837945.786190:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037061888:0@lo:400:kworker.0 00000100:00080000:2.0:1788837945.786327:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837945.786340:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037062144 00000100:00100000:2.0:1788837945.786345:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037062144 00000100:00100000:2.0:1788837945.786378:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037062656 00000100:00100000:2.0:1788837945.786381:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037062656 00000100:00100000:2.0:1788837945.786400:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788837945.786407:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037062144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837945.786481:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037061760:0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.786886:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837945.786930:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037062400:0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.786958:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837945.786978:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732037062912:0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.787001:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837945.787017:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037063424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837945.787038:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837945.787191:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037061888 00000100:00100000:0.0:1788837945.787196:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037061888 00000100:00100000:0.0:1788837945.787228:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788837945.787250:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037061888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.787428:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037063168:0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.787476:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837945.787494:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788837945.787501:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037062016:0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.787524:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837945.787549:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037062528:0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.787570:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837945.787587:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732037063040:0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.787606:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837945.787629:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037062912 00000100:00100000:1.0:1788837945.787632:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037062912 00000100:00100000:1.0:1788837945.787664:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037063168 00000100:00100000:1.0:1788837945.787667:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037063168 00000100:00100000:1.0:1788837945.787679:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037063040 00000100:00100000:1.0:1788837945.787682:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037063040 00000100:00100000:1.0:1788837945.787694:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788837945.787700:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037062656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.787752:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037062656:12345-0@lo:400:kworker.0 Request processed in 39us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.787759:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788837945.787789:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788837945.787798:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732037062912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.787826:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732037062912:12345-0@lo:400:kworker.0 Request processed in 31us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.787832:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788837945.787843:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788837945.787848:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732037063168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.787885:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732037063168:12345-0@lo:400:kworker.0 Request processed in 37us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.787891:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788837945.787914:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788837945.787920:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732037063040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.787943:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732037063040:12345-0@lo:400:kworker.0 Request processed in 24us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.787949:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788837945.787963:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837945.787966:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837945.787975:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037062400 00000100:00100000:1.0:1788837945.787979:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037062400 00000100:00100000:1.0:1788837945.788008:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037062016 00000100:00100000:1.0:1788837945.788011:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037062016 00000100:00100000:1.0:1788837945.788020:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037062528 00000100:00100000:1.0:1788837945.788022:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037062528 00000100:00100000:1.0:1788837945.788034:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788837945.788040:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037062400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.788633:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037061888:12345-0@lo:400:kworker.0 Request processed in 60us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837945.788643:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788837945.788677:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837945.788686:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037062016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.788743:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037062016:12345-0@lo:400:kworker.0 Request processed in 58us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837945.788758:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837945.788771:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837945.788792:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037062528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.788822:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037062528:12345-0@lo:400:kworker.0 Request processed in 46us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837945.788828:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837945.788847:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037063424 00000100:00100000:0.0:1788837945.788852:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037063424 00000100:00100000:0.0:1788837945.788881:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837945.788888:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875732037063424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837945.788914:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788837945.788946:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875732037063424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837945.788952:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837945.788998:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037063424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837945.789009:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037061888:0@lo:400:kworker.0 00010000:00080000:0.0:1788837945.789022:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7eaaa00 x1875732037062912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837945.789032:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732037062912:0@lo:400:kworker.0 00000100:00080000:0.0:1788837945.789252:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837945.789256:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837945.789277:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037062016:0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.789287:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037062528:0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.789383:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732037063040:0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.789395:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037062656:0@lo:400:kworker.0 00010000:00080000:0.0:1788837945.789406:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7ea9880 x1875732037063168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837945.789415:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037063168:0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.789692:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037062400:12345-0@lo:400:kworker.0 Request processed in 1651us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.789700:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788837945.790492:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037062144:12345-0@lo:400:kworker.0 Request processed in 4081us (4449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837945.790514:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788837945.790709:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037062400:0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.790811:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037062144:0@lo:400:kworker.0 00000100:00100000:3.0:1788837945.790935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837945.791020:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037062272:0@lo:400:kworker.0 00000100:00100000:3.0:1788837945.791068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837945.791096:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037062784:0@lo:400:kworker.0 00000100:00100000:2.0:1788837945.791232:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037062272 00000100:00100000:2.0:1788837945.791238:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037062272 00000100:00100000:2.0:1788837945.791281:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788837945.791289:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037062272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837945.791341:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037062272:12345-0@lo:400:kworker.0 Request processed in 53us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837945.791347:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788837945.791593:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837945.791625:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037063296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837945.791661:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837945.791699:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037062272:0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.791762:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037062784 00000100:00100000:0.0:1788837945.791767:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037062784 00000100:00100000:0.0:1788837945.791834:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788837945.791842:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037062784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.791880:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037062784:12345-0@lo:400:kworker.0 Request processed in 39us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837945.791887:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788837945.791966:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037063296 00000100:00100000:2.0:1788837945.791970:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037063296 00000100:00100000:2.0:1788837945.792003:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788837945.792009:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037063296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837945.792025:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788837945.792918:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037063296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 904us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837945.792927:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788837945.792994:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837945.793026:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037062784:0@lo:400:kworker.0 00000100:00100000:3.0:1788837945.793043:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037063296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837945.793241:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037061760 00000100:00100000:1.0:1788837945.793247:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037061760 00000100:00100000:1.0:1788837945.793389:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788837945.793398:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3650:x1875732037061760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837945.793598:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3650:x1875732037061760:12345-0@lo:400:kworker.0 Request processed in 200us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837945.793617:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788837945.793686:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037061760:0@lo:400:kworker.0 00000100:00100000:0.0:1788837945.932301:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837945.932349:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837945.932393:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837945.932528:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012873216 00000100:00100000:2.0:1788837945.932538:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012873216 00000100:00100000:2.0:1788837945.932598:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012873472 00000100:00100000:2.0:1788837945.932602:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012873472 00000100:00100000:2.0:1788837945.932613:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012873344 00000100:00100000:2.0:1788837945.932615:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012873344 00000100:00100000:2.0:1788837945.932630:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:2.0:1788837945.932639:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:2395:x1875732012873216:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837945.932654:0:20228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837945.932673:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6dac00/0x57f6d4e926af0608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee73 expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.932706:0:20228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837945.932755:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:2395:x1875732012873216:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 117us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837945.932762:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:2.0:1788837945.932824:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788837945.932831:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:2395:x1875732012873472:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837945.932839:0:20228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837945.932848:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afbea7400/0x57f6d4e926af064e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eee3 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.932858:0:20228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837945.932874:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7253ef40-cd6d-4a26-9386-e23758a56a4e+9:2395:x1875732012873472:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 45us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837945.932881:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788837945.932903:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:2.0:1788837945.932911:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7253ef40-cd6d-4a26-9386-e23758a56a4e+8:2395:x1875732012873344:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837945.932918:0:20228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837945.932927:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6db600/0x57f6d4e926af060f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eea4 expref: 8 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837945.932935:0:20228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837945.932951:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7253ef40-cd6d-4a26-9386-e23758a56a4e+7:2395:x1875732012873344:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 41us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837945.932957:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:3.0:1788837945.943821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837945.943981:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012873728 00000100:00100000:0.0:1788837945.943992:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012873728 00000100:00080000:3.0:1788837945.944128:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837945.944222:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:0.0:1788837945.944235:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2392:x1875732012873728:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:0.0:1788837945.944278:0:17201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af061d 00000020:00010000:0.0:1788837945.944285:0:17201:0:(genops.c:1921:obd_stale_export_put()) Put export ffff889ac6be6800: total 0 00000100:00080000:0.0:1788837945.944291:0:17201:0:(import.c:65:import_set_state_nolock()) ffff889ac6be1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837945.944361:0:17201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1788837945.944509:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2392:x1875732012873728:12345-192.168.201.3@tcp:39:umount.0 Request processed in 276us (696us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788837945.944530:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 69 00000020:00010000:1.0:1788837945.944592:0:17953:0:(genops.c:1907:obd_stale_export_get()) Get export ffff889ac6be6800: total 0 00010000:00010000:1.0:1788837945.944640:0:17953:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff889ac6be6800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788837945.944672:0:17953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1fc00) 00010000:00010000:1.0:1788837945.944676:0:17953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837945.944684:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926af0712 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef0d expref: 4 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.944706:0:17953:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff889ac6be6800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788837945.944717:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837945.944719:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837945.944721:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837945.952495:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837945.952655:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012873856 00000100:00100000:0.0:1788837945.952665:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012873856 00000100:00100000:0.0:1788837945.952744:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00100000:0.0:1788837945.952754:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2392:x1875732012873856:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:0.0:1788837945.952812:0:17200:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0624 00000100:00080000:0.0:1788837945.952822:0:17200:0:(import.c:65:import_set_state_nolock()) ffff889ac6be1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837945.952850:0:17200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788837945.952998:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+3:2392:x1875732012873856:12345-192.168.201.3@tcp:39:umount.0 Request processed in 245us (514us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788837945.953006:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00080000:3.0:1788837945.953241:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788837945.953962:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837945.991047:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837945.992466:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012874112 00000100:00100000:0.0:1788837945.992479:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012874112 00000100:00100000:0.0:1788837945.992547:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 175 00000100:00100000:0.0:1788837945.992557:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+7:2392:x1875732012874112:12345-192.168.201.3@tcp:251:umount.0 00000020:00000080:0.0:1788837945.992602:0:17195:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af05bb 00000020:00010000:0.0:1788837945.992609:0:17195:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8899c36a0800: total 0 00000100:00080000:0.0:1788837945.992614:0:17195:0:(import.c:65:import_set_state_nolock()) ffff8899c36a3800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788837945.992697:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+3:2392:x1875732012874112:12345-192.168.201.3@tcp:251:umount.0 Request processed in 141us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837945.992704:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 175 00000020:00010000:1.0:1788837945.993240:0:17189:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8899c36a0800: total 0 00010000:00010000:1.0:1788837945.993295:0:17189:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8899c36a0800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788837945.993343:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af05c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edfc expref: 2 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837945.993358:0:17189:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8899c36a0800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788837945.993369:0:17189:0:(genops.c:885:class_export_put()) final put ffff8899c36a0800/7253ef40-cd6d-4a26-9386-e23758a56a4e 00010000:00010000:1.0:1788837945.993390:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837945.993392:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837945.993394:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788837945.993466:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c36a0800/7253ef40-cd6d-4a26-9386-e23758a56a4e for MGS 00000020:00000080:2.0:1788837945.993506:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c36a3800 for MGS 00000100:00100000:1.0:1788837946.305265:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037063680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837946.305338:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837946.305388:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837946.305395:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037063552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837946.305420:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837946.305452:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037063680 00000100:00100000:1.0:1788837946.305466:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037063680 00000100:00100000:1.0:1788837946.305506:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037063552 00000100:00100000:1.0:1788837946.305509:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037063552 00000100:00100000:1.0:1788837946.305526:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788837946.305534:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037063680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837946.305568:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788837946.305614:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037063680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837946.305621:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788837946.305637:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837946.305643:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037063552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837946.305658:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788837946.305685:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037063552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837946.305691:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837946.305727:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037063552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837946.305739:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037063680:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788837946.682486:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837947.704963:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788837947.920747:0:20773:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788837947.944652:0:20773:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788837947.944713:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837947.944730:0:20773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837947.944765:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837947.944955:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837947.945008:0:20773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788837947.945014:0:20773:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788837947.945043:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788837947.945048:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788837947.945054:0:20773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788837947.945079:0:20773:0:(import.c:65:import_set_state_nolock()) ffff8899c3647000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788837947.945127:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837947.945133:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.945141:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6a00 already unused, calling callback (ffffffffc122ac20) 00000100:00100000:3.0:1788837947.945145:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037063808:0@lo:39:umount.0 10000000:00010000:1.0:1788837947.945145:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.945154:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837947.945167:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837947.945173:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788837947.945175:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788837947.945178:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788837947.945203:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.945209:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788837947.945212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837947.945248:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788837947.945265:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.945273:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.945286:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837947.945288:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837947.945289:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837947.945319:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037063936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837947.945351:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837947.945526:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037063936 00000100:00100000:3.0:1788837947.945533:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037063936 00000100:00100000:3.0:1788837947.945581:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837947.945591:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4babb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3651:x1875732037063936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837947.945603:0:20228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837947.945618:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac1324200/0x57f6d4e926af0185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af017e expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837947.945630:0:20228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837947.945663:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4babb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:3651:x1875732037063936:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837947.945670:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837947.945688:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037063936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837947.945728:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037063808 00000100:00100000:2.0:1788837947.945733:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037063808 00000100:00100000:2.0:1788837947.945771:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788837947.945813:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875732037063808:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788837947.945835:0:19205:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af01af 00000100:00080000:2.0:1788837947.945842:0:19205:0:(import.c:65:import_set_state_nolock()) ffff889ac4e48800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788837947.945916:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1875732037063808:12345-0@lo:39:umount.0 Request processed in 104us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.945923:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1788837947.945930:0:19205:0:(genops.c:885:class_export_put()) final put ffff8899c247c000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1788837947.945949:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c3647000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788837947.945956:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037063808:0@lo:39:umount.0 00000020:00000080:2.0:1788837947.945957:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c247c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788837947.945996:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ac4e48800 for lustre-MDT0000 00010000:00010000:3.0:1788837947.946169:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788837947.946422:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788837947.946425:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788837947.946429:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788837947.949690:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949709:0:20773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949716:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949730:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949764:0:20773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837947.949772:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949812:0:20773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949819:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949826:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949841:0:20773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788837947.949847:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949854:0:20773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949872:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949877:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949900:0:20773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788837947.949905:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949912:0:20773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949918:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949924:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837947.949931:0:20773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788837947.949934:0:20773:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788837947.949936:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788837947.949944:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.949951:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325200 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837947.949955:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788837947.949962:0:20773:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00010000:00010000:2.0:1788837947.949963:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788837947.949966:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788837947.949969:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:2.0:1788837947.949970:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788837947.949974:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788837947.949982:0:20773:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8899c36a6800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:2.0:1788837947.949985:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837947.949987:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000020:00080000:1.0:1788837947.949988:0:20773:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8899c277d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:2.0:1788837947.949990:0:17188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:1.0:1788837947.949993:0:20773:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff889af8e37800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788837947.949996:0:20773:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff889ad20f4000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788837947.950003:0:20773:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff889ac6be6800 8cd2a6f9-4711-474b-ad66-0a44190716b9 192.168.201.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1788837947.950007:0:20773:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff889ac84ba000 067bdd78-c556-4265-9b97-e4112a37245c 192.168.201.3@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:1.0:1788837947.950012:0:20773:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8899c26699b8) has exports, disconnecting them 00000020:00080000:1.0:1788837947.950019:0:20773:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8899c36a6800), last request at 1788837945 00010000:00010000:2.0:1788837947.950023:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788837947.950026:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af04aa 00010000:00010000:2.0:1788837947.950028:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1788837947.950043:0:20773:0:(import.c:65:import_set_state_nolock()) ffff8899c36a3000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788837947.950050:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950057:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950079:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788837947.950082:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788837947.950086:0:20773:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c36a6800): rc 0 00010000:00010000:2.0:1788837947.950088:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6000 already unused, calling callback (ffffffffc122ac20) 00000020:00000080:1.0:1788837947.950088:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c36a6800/lustre-MDT0000-lwp-OST0001_UUID 10000000:00010000:2.0:1788837947.950091:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950097:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788837947.950098:0:20773:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8899c277d000), last request at 1788837945 00000020:00000080:1.0:1788837947.950101:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af034c 10000000:00010000:2.0:1788837947.950104:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788837947.950106:0:20773:0:(import.c:65:import_set_state_nolock()) ffff8899c277f000 : changing import state from FULL to CLOSED 10000000:01000000:2.0:1788837947.950109:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837947.950111:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00080000:1.0:1788837947.950112:0:20773:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c277d000): rc 0 00000020:00000080:1.0:1788837947.950114:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c277d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788837947.950117:0:20773:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff889af8e37800), last request at 1788837869 10000000:01000000:2.0:1788837947.950118:0:17188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:1.0:1788837947.950120:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af029d 00000100:00080000:1.0:1788837947.950123:0:20773:0:(import.c:65:import_set_state_nolock()) ffff889af8e37000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788837947.950127:0:20773:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889af8e37800): rc 0 00000020:00000080:1.0:1788837947.950129:0:20773:0:(genops.c:885:class_export_put()) final put ffff889af8e37800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:2.0:1788837947.950131:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788837947.950133:0:20773:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff889ad20f4000), last request at 1788837869 00000020:00000080:1.0:1788837947.950136:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af023b 00010000:00010000:2.0:1788837947.950137:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1788837947.950139:0:20773:0:(import.c:65:import_set_state_nolock()) ffff889af8dbf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837947.950144:0:20773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00010000:00010000:2.0:1788837947.950150:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950156:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950164:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837947.950167:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950172:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da000 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837947.950174:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950180:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837947.950185:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837947.950189:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788837947.950191:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788837947.950192:0:17188:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788837947.950201:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950207:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1788837947.950208:0:20773:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889ad20f4000): rc 0 00000004:00000080:1.0:1788837947.950214:0:20773:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa3bc80c97ae0 00010000:00010000:2.0:1788837947.950218:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950223:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788837947.950229:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:2.0:1788837947.950231:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837947.950233:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837947.950233:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788837947.950239:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837947.950241:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950248:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837947.950254:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837947.950259:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837947.950261:0:17188:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788837947.950263:0:17188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788837947.950272:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950278:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837947.950282:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950289:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950306:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837947.950308:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837947.950310:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837947.950326:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037064064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837947.950398:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.950454:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837947.950460:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037064448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837947.950482:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.950505:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037064192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837947.950524:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.950539:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837947.950544:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037064320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837947.950560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.950586:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037064064 00000100:00100000:2.0:1788837947.950591:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037064064 00000100:00100000:2.0:1788837947.950626:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037064448 00000100:00100000:2.0:1788837947.950629:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037064448 00000100:00100000:2.0:1788837947.950645:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037064192 00000100:00100000:2.0:1788837947.950647:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037064192 00000100:00100000:2.0:1788837947.950655:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037064320 00000100:00100000:2.0:1788837947.950657:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037064320 00000100:00100000:2.0:1788837947.950670:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788837947.950677:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+26:3651:x1875732037064064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837947.950688:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837947.950700:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9b000/0x57f6d4e926af00d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af00cf expref: 26 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950723:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837947.950755:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+25:3651:x1875732037064064:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.950762:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788837947.950808:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837947.950814:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3651:x1875732037064448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837947.950821:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837947.950829:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926af00c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af00c1 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950838:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837947.950857:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:3651:x1875732037064448:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.950874:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837947.950906:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837947.950911:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:3648:x1875732037064192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837947.950918:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837947.950925:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8a00/0x57f6d4e926af04e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af04db expref: 22 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.950933:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837947.950955:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3648:x1875732037064192:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.950961:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837947.950972:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788837947.950977:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:3648:x1875732037064320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837947.950989:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837947.950997:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afbea7200/0x57f6d4e926af0686 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af067f expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837947.951005:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837947.951023:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:3648:x1875732037064320:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837947.951029:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:00000080:2.0:1788837947.951054:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c36a6800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788837947.951086:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c277d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1788837947.951088:0:20773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788837947.951101:0:20773:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:2.0:1788837947.951105:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8e37800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788837947.951123:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c36a3000 for lustre-MDT0000 00000100:00100000:1.0:1788837947.951124:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037064576:0@lo:39:umount.0 00000020:00000080:2.0:1788837947.951127:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c277f000 for lustre-MDT0000 00000020:00000080:2.0:1788837947.951131:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889af8e37000 for lustre-MDT0000 00000100:00100000:1.0:1788837947.951155:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.951157:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037064320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837947.951165:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037064192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837947.951184:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037064576 00000100:00100000:1.0:1788837947.951193:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037064576 00000100:00100000:2.0:1788837947.951198:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037064448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837947.951204:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037064064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837947.951220:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788837947.951226:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875732037064576:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788837947.951246:0:18161:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af02c7 00000100:00080000:1.0:1788837947.951251:0:18161:0:(import.c:65:import_set_state_nolock()) ffff889af8e36800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837947.951267:0:18161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:0.0:1788837947.951311:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837947.951353:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3647:x1875732037064576:12345-0@lo:39:umount.0 Request processed in 128us (197us total) trans 8589934595 rc 0/0 00010000:00010000:2.0:1788837947.951944:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788837947.952015:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788837947.952018:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1788837947.952035:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788837947.952159:0:20773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788837947.952175:0:20773:0:(import.c:65:import_set_state_nolock()) ffff889ad114d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788837947.952184:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788837947.952194:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1788837947.952204:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788837947.952263:0:20773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788837947.952272:0:20773:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788837947.952313:0:20773:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8899c26699b8) has no exports 00010000:00010000:3.0:1788837947.952432:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837947.952570:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037064704:0@lo:9:umount.0 00000100:00100000:2.0:1788837947.952616:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837947.952648:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037064832:0@lo:9:umount.0 00000100:00100000:2.0:1788837947.952666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788837947.952692:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788837947.952698:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037064576:0@lo:39:umount.0 00000100:00100000:0.0:1788837947.952752:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037064704 00000100:00100000:0.0:1788837947.952758:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037064704 00000100:00100000:0.0:1788837947.952835:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037064832 00000100:00100000:0.0:1788837947.952839:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037064832 00000100:00100000:0.0:1788837947.952870:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837947.952879:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875732037064704:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788837947.952898:0:18707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0392 00000100:00080000:0.0:1788837947.952912:0:18707:0:(import.c:65:import_set_state_nolock()) ffff8899c277a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837947.952950:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788837947.953051:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3647:x1875732037064704:12345-0@lo:9:umount.0 Request processed in 174us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837947.953059:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837947.953087:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837947.953093:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875732037064832:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788837947.953105:0:18707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af04e9 00000100:00080000:0.0:1788837947.953111:0:18707:0:(import.c:65:import_set_state_nolock()) ffff8899c4406800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837947.953130:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788837947.953211:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3647:x1875732037064832:12345-0@lo:9:umount.0 Request processed in 118us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837947.953218:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1788837947.953240:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837947.953244:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788837947.953259:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad114d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788837947.953268:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788837947.953270:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788837947.953273:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037064704:0@lo:9:umount.0 00000100:00080000:0.0:1788837947.953283:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788837947.953286:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788837947.953287:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788837947.953289:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037064832:0@lo:9:umount.0 00000100:00080000:2.0:1788837947.953585:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837947.953588:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837947.954606:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00080000:2.0:1788837947.964735:0:20773:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8899c26699b8) has no exports 00000020:00000080:2.0:1788837948.025032:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af011c 00000020:00000080:2.0:1788837948.025047:0:20773:0:(genops.c:885:class_export_put()) final put ffff889b01bb1000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788837948.025062:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788837948.025156:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889b01bb1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788837948.025267:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837948.025277:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788837948.025282:0:20773:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff889afc3f99b8) has no exports 00000020:00000080:3.0:1788837948.026592:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0115 00000020:00000080:3.0:1788837948.026601:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c21e1000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788837948.026667:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837948.026676:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788837948.026679:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c21e3000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788837948.026682:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788837948.026690:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788837948.026902:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788837948.735626:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837949.753143:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788837949.892110:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788837949.892120:0:17180:0:(genops.c:885:class_export_put()) final put ffff889ad20f4000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788837949.892141:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8cd2a6f9-4711-474b-ad66-0a44190716b9 00000001:00080000:2.0:1788837949.892149:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1788837949.892153:0:17180:0:(genops.c:885:class_export_put()) final put ffff889ac6be6800/8cd2a6f9-4711-474b-ad66-0a44190716b9 00000001:00100000:2.0:1788837949.892158:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 067bdd78-c556-4265-9b97-e4112a37245c 00000001:00080000:2.0:1788837949.892162:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1788837949.892168:0:17180:0:(genops.c:885:class_export_put()) final put ffff889ac84ba000/067bdd78-c556-4265-9b97-e4112a37245c 00000020:00000080:3.0:1788837949.892738:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad20f4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788837949.892839:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac6be6800/8cd2a6f9-4711-474b-ad66-0a44190716b9 for lustre-MDT0000 00000020:00000080:3.0:1788837949.892863:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac84ba000/067bdd78-c556-4265-9b97-e4112a37245c for lustre-MDT0000 00000020:00000080:3.0:1788837949.892889:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889af8dbf800 for lustre-MDT0000 00000020:00000080:3.0:1788837949.892894:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ac6be1800 for lustre-MDT0000 00000020:00000080:3.0:1788837949.892897:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ac84b8800 for lustre-MDT0000 00000001:00100000:1.0:1788837949.894261:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788837949.894269:0:18703:0:(genops.c:885:class_export_put()) final put ffff8899c277c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788837949.894295:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 067bdd78-c556-4265-9b97-e4112a37245c 00000020:00000080:1.0:1788837949.894297:0:18703:0:(genops.c:885:class_export_put()) final put ffff889aded38000/067bdd78-c556-4265-9b97-e4112a37245c 00000020:00000080:0.0:1788837949.894356:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c277c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788837949.894412:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889aded38000/067bdd78-c556-4265-9b97-e4112a37245c for lustre-OST0000 00000020:00000080:0.0:1788837949.894456:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c277a800 for lustre-OST0000 00000020:00000080:0.0:1788837949.894460:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889aded3e800 for lustre-OST0000 00000001:00100000:2.0:1788837949.895503:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788837949.895518:0:17933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1788837949.895535:0:17933:0:(genops.c:885:class_export_put()) final put ffff889af8e31800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788837949.895556:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8cd2a6f9-4711-474b-ad66-0a44190716b9 00000001:00080000:2.0:1788837949.895560:0:17933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1788837949.895562:0:17933:0:(genops.c:885:class_export_put()) final put ffff889ac6be2800/8cd2a6f9-4711-474b-ad66-0a44190716b9 00000001:00100000:2.0:1788837949.895567:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 067bdd78-c556-4265-9b97-e4112a37245c 00000001:00080000:2.0:1788837949.895570:0:17933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1788837949.895572:0:17933:0:(genops.c:885:class_export_put()) final put ffff889b00cdf800/067bdd78-c556-4265-9b97-e4112a37245c 00000020:00000080:3.0:1788837949.895690:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8e31800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788837949.895750:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac6be2800/8cd2a6f9-4711-474b-ad66-0a44190716b9 for lustre-MDT0001 00000020:00000080:3.0:1788837949.895814:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889b00cdf800/067bdd78-c556-4265-9b97-e4112a37245c for lustre-MDT0001 00000020:00000080:3.0:1788837949.895852:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889af8e36800 for lustre-MDT0001 00000020:00000080:3.0:1788837949.895857:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ac6be1000 for lustre-MDT0001 00000020:00000080:3.0:1788837949.895860:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889aded3e000 for lustre-MDT0001 00000020:01000000:3.0:1788837950.073053:0:20773:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889ac4417540 - data ffff889ad1be5000/ffff889afbeae800 00000020:01000000:3.0:1788837950.073218:0:20773:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8899c2466060 - data ffff889ae51ef5e8/ffff889afbea0400 00000001:00000004:3.0:1788837950.095421:0:20773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1788837950.159144:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837950.159154:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788837950.159186:0:20773:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff889ae7ea8380 x1875732037064576/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788837957 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837950.159210:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788837950.162700:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788837950.162708:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788837950.162733:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837950.162736:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788837950.163995:0:17224:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788837950.164002:0:17224:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1788837950.164014:0:17224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788837950.177468:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788837950.177477:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788837950.177502:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837950.177504:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788837950.178011:0:17226:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788837950.178016:0:17226:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1788837950.178027:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788837950.179337:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af00e4 00000020:00000080:1.0:1788837950.179349:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c247d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788837950.180088:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c247d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788837950.182960:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af00f9 00000020:00000080:1.0:1788837950.182975:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c247f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788837950.182991:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788837950.182996:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837950.183004:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788837950.183008:0:20773:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8899c2668000) has no exports 00000004:01000000:1.0:1788837950.183182:0:20773:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788837950.183191:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af015b 00000020:00000080:1.0:1788837950.183195:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c21e5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788837950.183199:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788837950.183204:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837950.183221:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788837950.183223:0:20773:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff889afc3f8000) has no exports 00000020:00000080:1.0:1788837950.183229:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0154 00000020:00000080:1.0:1788837950.183232:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c21e4000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788837950.183690:0:20773:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788837950.183695:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788837950.183700:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788837950.183705:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837950.183707:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788837950.183738:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837950.183744:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788837950.183749:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0146 00000020:00000080:1.0:1788837950.183753:0:20773:0:(genops.c:885:class_export_put()) final put ffff889affb22000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788837950.183757:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788837950.183760:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837950.183763:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788837950.183765:0:20773:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff889ae7f3cd28) has no exports 00000020:00000080:1.0:1788837950.183769:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af013f 00000020:00000080:1.0:1788837950.183771:0:20773:0:(genops.c:885:class_export_put()) final put ffff889affb24000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788837950.184200:0:20773:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788837950.184206:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788837950.184208:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788837950.184213:0:20773:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837950.184214:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788837950.195340:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c247f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788837950.195360:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788837950.195367:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788837950.195384:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c21e7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788837950.195396:0:37:0:(genops.c:885:class_export_put()) final put ffff889affb21000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788837950.195399:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb21000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788837950.195404:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837950.195509:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb22000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788837950.195515:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb24000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788837950.201138:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ad114d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788837950.201175:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837950.201188:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788837950.201193:0:20773:0:(genops.c:885:class_export_put()) final put ffff889affb22800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788837950.201197:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb22800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788837950.201207:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788837950.201299:0:20773:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788837950.201307:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0131 00000020:00000080:1.0:1788837950.201634:0:20773:0:(genops.c:885:class_export_put()) final put ffff889affb21800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788837950.201664:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788837950.201668:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837950.201674:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788837950.201678:0:20773:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8899c36499b8) has no exports 00000020:00000080:1.0:1788837950.201685:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af012a 00000020:00000080:1.0:1788837950.201689:0:20773:0:(genops.c:885:class_export_put()) final put ffff889adea43000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788837950.201940:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb21800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788837950.201952:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889adea43000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788837950.206852:0:20773:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788837950.206861:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788837950.206865:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788837950.206872:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788837950.206932:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837950.206944:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837950.206984:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837950.207003:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837950.207009:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c3644000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788837950.207014:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3644000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788837950.207021:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837950.207139:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0100 00000020:00000080:0.0:1788837950.207146:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c247e800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788837950.207152:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788837950.207155:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837950.207161:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788837950.207164:0:20773:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8899c266b370) has no exports 00000020:00000080:0.0:1788837950.207184:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837950.207187:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788837950.207191:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0107 00000020:00000080:0.0:1788837950.207195:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c2479000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788837950.207203:0:20773:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ac409c800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788837950.207207:0:20773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac409c800 3 00000020:01000004:0.0:1788837950.207210:0:20773:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889ac409c800 from lustre-MDT0000 00000020:00000080:0.0:1788837950.207227:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837950.207231:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788837950.207233:0:20773:0:(genops.c:885:class_export_put()) final put ffff8899c247d000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788837950.207235:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c247d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788837950.207242:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788837950.207271:0:20773:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788837950.207275:0:20773:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788837950.207277:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788837950.207280:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837950.207283:0:20773:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788837950.207290:0:20773:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff889b01ba0800 d42f6ebb-a489-4c0b-be2b-e965e16a506d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837950.207296:0:20773:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8899c364cd28) has exports, disconnecting them 00000020:00080000:0.0:1788837950.207300:0:20773:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff889b01ba0800), last request at 1788837853 00000020:00000080:0.0:1788837950.207315:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af00ac 00000020:00010000:0.0:1788837950.207318:0:20773:0:(genops.c:1921:obd_stale_export_put()) Put export ffff889b01ba0800: total 2 00000100:00080000:0.0:1788837950.207328:0:20773:0:(import.c:65:import_set_state_nolock()) ffff889b01ba5000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788837950.207342:0:20773:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889b01ba0800): rc 0 00000020:00080000:0.0:1788837950.207347:0:20773:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8899c364cd28) has no exports 00000020:00010000:0.0:1788837950.207358:0:17188:0:(genops.c:1907:obd_stale_export_get()) Get export ffff889b01ba0800: total 2 00010000:00010000:0.0:1788837950.207362:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837950.207386:0:17188:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff889b01ba0800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788837950.207418:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8200/0x57f6d4e926af01e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af01e0 expref: 14 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207435:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8600/0x57f6d4e926af04d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af04cd expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207449:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8000/0x57f6d4e926af065c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af0655 expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207459:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afbea6a00/0x57f6d4e926af0678 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af0671 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207471:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afbea7e00/0x57f6d4e926af046b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af0464 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207480:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6da600/0x57f6d4e926af066a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af0663 expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207490:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af030d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af0306 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207502:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9a600/0x57f6d4e926af0337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af0330 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207512:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac1324a00/0x57f6d4e926af0288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af0281 expref: 6 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207532:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c9600/0x57f6d4e926af01d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af01d2 expref: 5 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207545:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6db200/0x57f6d4e926af0495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af048e expref: 4 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207555:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ad8ac6c00/0x57f6d4e926af00ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af00b3 expref: 3 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207569:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac1324400/0x57f6d4e926af01cb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926af01c4 expref: 2 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837950.207579:0:17188:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff889b01ba0800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788837950.207594:0:17188:0:(genops.c:885:class_export_put()) final put ffff889b01ba0800/d42f6ebb-a489-4c0b-be2b-e965e16a506d 00010000:00010000:0.0:1788837950.207599:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837950.207601:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837950.207602:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837950.207666:0:17195:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff889af990ba00:17195] 2 exiting: rc = 0 00000100:00100000:0.0:1788837950.207832:0:17192:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8899c34ce600:17192] 0 exiting: rc = 1 00000100:00100000:3.0:1788837950.207963:0:17194:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff889af990ac00:17194] 1 exiting: rc = 0 00000020:00000080:3.0:1788837950.208027:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889adea42000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788837950.208035:0:37:0:(genops.c:885:class_export_put()) final put ffff889adea41000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788837950.208037:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889adea41000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788837950.208041:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837950.208094:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c247e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788837950.208098:0:37:0:(genops.c:885:class_export_put()) final put ffff8899c247f000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788837950.208100:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c247f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788837950.208103:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788837950.208127:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c2479000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788837950.208134:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889b01ba0800/d42f6ebb-a489-4c0b-be2b-e965e16a506d for MGS 00000020:00000080:3.0:1788837950.208159:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889b01ba5000 for MGS 00000100:00100000:0.0:1788837950.209423:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209433:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209438:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209444:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209452:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209458:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209463:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209469:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209474:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209482:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209487:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209508:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209514:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209519:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209525:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209532:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209537:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209543:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209548:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209553:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209559:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209564:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209570:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209576:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209581:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209586:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209591:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209597:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209603:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209608:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209614:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209619:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209625:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209630:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209636:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209642:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209647:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209653:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209658:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209664:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209669:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209674:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209680:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209700:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209707:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209712:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209725:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209730:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209736:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209741:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209747:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209752:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209758:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209764:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.209769:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.212978:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.213002:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.213009:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.213014:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.213020:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.213091:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.213100:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.213106:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837950.213112:0:20773:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788837950.215744:0:20773:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889ac6bf3a80 - data ffff889ae50160d8/ffff889ac6b47400 00000020:01000000:0.0:1788837950.215910:0:20773:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889afa795120 - data ffff889ae51181b0/ffff889afa7fbc00 00000020:00000080:3.0:1788837950.216580:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0090 00000020:00000080:3.0:1788837950.216590:0:20773:0:(genops.c:885:class_export_put()) final put ffff889af8df8000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788837950.216613:0:20773:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ac409c800 from MGS, refs=2 00000020:01000004:3.0:1788837950.216618:0:20773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac409c800 2 00000020:01000004:3.0:1788837950.216621:0:20773:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889ac409c800 from MGS 00000020:00000080:3.0:1788837950.216640:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837950.216645:0:20773:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788837950.216648:0:20773:0:(genops.c:885:class_export_put()) final put ffff889af8dfd800/MGS 00000020:00000080:3.0:1788837950.216651:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8dfd800/MGS for MGS 00000020:01000000:3.0:1788837950.216657:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788837950.216724:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788837950.216737:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837950.216743:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788837950.216750:0:20773:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff889ad1796000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837950.216756:0:20773:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8899c3648000) has exports, disconnecting them 00000020:00080000:3.0:1788837950.216761:0:20773:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff889ad1796000), last request at 1788837853 00000020:00000080:3.0:1788837950.216765:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0193 00000020:00080000:3.0:1788837950.216797:0:20773:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889ad1796000): rc 0 00000020:00000080:3.0:1788837950.216802:0:20773:0:(genops.c:885:class_export_put()) final put ffff889ad1796000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788837950.218498:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8df8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788837950.218512:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad1796000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788837950.224877:0:20773:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788837950.224886:0:20773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788837950.224890:0:20773:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788837950.224898:0:20773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788837950.224932:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c3647000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788837950.225115:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837950.225124:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788837950.225130:0:20773:0:(genops.c:885:class_export_put()) final put ffff889adea48000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788837950.225134:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff889adea48000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788837950.225142:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788837950.225231:0:20773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac409c800 1 00000020:00000080:0.0:1788837950.225238:0:20773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0082 00000020:00000080:0.0:1788837950.225244:0:20773:0:(genops.c:885:class_export_put()) final put ffff889af8df9000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788837950.225253:0:20773:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788837950.225260:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8df9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788837950.225269:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837950.225273:0:20773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788837950.225277:0:20773:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff889afc3fb370) has no exports 00000020:00000080:1.0:1788837950.597964:0:20773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837950.597977:0:20773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788837950.597982:0:20773:0:(genops.c:885:class_export_put()) final put ffff889ac409b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788837950.597986:0:20773:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac409b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788837950.597997:0:20773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788837950.598115:0:20773:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff889ac4098000 00000020:02000400:1.0:1788837950.598174:0:20773:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788837950.786128:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837950.906478:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037064960:0@lo:400:kworker.0 00000400:00000100:3.0:1788837950.906534:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875732037064960 offset 0 length 224: 4 00000100:00100000:3.0:1788837950.912111:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732037065472:0@lo:400:kworker.0 00000100:00100000:3.0:1788837950.912188:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837950.912227:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732037065984:0@lo:400:kworker.0 00000100:00100000:2.0:1788837950.912854:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037065216:0@lo:400:kworker.0 00000100:00100000:2.0:1788837950.912893:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837950.912917:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732037065728:0@lo:400:kworker.0 00000100:00100000:2.0:1788837950.912946:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037065088:0@lo:400:kworker.0 00000100:00100000:2.0:1788837950.912971:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837950.912988:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732037065600:0@lo:400:kworker.0 00000100:00100000:3.0:1788837950.913046:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837950.913216:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037065472 00000100:00100000:3.0:1788837950.913224:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037065472 00000100:00100000:3.0:1788837950.913261:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037065984 00000100:00100000:3.0:1788837950.913264:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037065984 00000100:00100000:2.0:1788837950.913686:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037065344:0@lo:400:kworker.0 00000100:00100000:2.0:1788837950.913721:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837950.913753:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037065856:0@lo:400:kworker.0 00000100:00100000:2.0:1788837950.913800:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837950.913909:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037065216 00000100:00100000:1.0:1788837950.913914:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037065216 00000100:00100000:1.0:1788837950.913944:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037065344 00000100:00100000:1.0:1788837950.913947:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037065344 00000100:00100000:1.0:1788837950.913968:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837950.913977:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037065216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837950.914941:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037065216:12345-0@lo:400:kworker.0 Request processed in 960us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837950.914951:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837950.914976:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837950.914984:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037065344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837950.915152:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037065344:12345-0@lo:400:kworker.0 Request processed in 169us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837950.915159:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837950.916258:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037065088 00000100:00100000:1.0:1788837950.916270:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037065088 00000100:00100000:1.0:1788837950.916341:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788837950.916347:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875732037065088:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788837950.916354:0:17205:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788837950.916561:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875732037065088:12345-0@lo:400:kworker.0 Request processed in 211us (3587us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788837950.916570:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788837950.920492:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037065344:0@lo:400:kworker.0 00000100:00100000:3.0:1788837950.930609:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037065856 00000100:00100000:3.0:1788837950.930664:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037065856 00000100:00100000:0.0:1788837950.930706:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788837950.930716:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788837950.930722:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1875732037065472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837950.930724:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732037065984:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788837950.930732:0:17202:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788837950.930842:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1875732037065472:12345-0@lo:400:kworker.0 Request processed in 118us (18653us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788837950.930842:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732037065984:12345-0@lo:400:kworker.0 Request processed in 123us (17795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837950.930849:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788837950.930852:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788837950.930867:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788837950.930885:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875732037065856:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788837950.930891:0:17202:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788837950.930925:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875732037065856:12345-0@lo:400:kworker.0 Request processed in 39us (17150us total) trans 0 rc -107/-107 00000100:00080000:2.0:1788837950.931676:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837950.931683:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837950.931685:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837950.932451:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788837950.932458:0:3651:0:(import.c:65:import_set_state_nolock()) ffff889af8e31000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788837950.932462:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788837950.934409:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788837950.936114:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837950.936232:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037066240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837950.936972:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837950.937139:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037065216:0@lo:400:kworker.0 00000100:00100000:2.0:1788837950.937177:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788837950.940970:0:3651:0:(import.c:65:import_set_state_nolock()) ffff889af8e31000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837950.940984:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 486 00000100:00080000:1.0:1788837950.940994:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff889af8e31000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837950.941288:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037066112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837950.941444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788837950.941490:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788837950.941494:0:3648:0:(import.c:65:import_set_state_nolock()) ffff889ac85f6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788837950.941498:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788837950.941502:0:3648:0:(import.c:65:import_set_state_nolock()) ffff889ac85f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837950.941505:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 486 00000100:00080000:2.0:1788837950.941509:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff889ac85f6800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837950.941538:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5fc380 x1875732037066368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837950.941560:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037065088:0@lo:400:kworker.0 00000100:00080000:2.0:1788837950.941598:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788837950.941602:0:3650:0:(import.c:65:import_set_state_nolock()) ffff889affb4d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788837950.941605:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788837950.941607:0:3650:0:(import.c:65:import_set_state_nolock()) ffff889affb4d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837950.941611:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 521 00000100:00080000:2.0:1788837950.941614:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff889affb4d000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837950.941624:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5fe300 x1875732037066496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837950.941636:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037065856:0@lo:400:kworker.0 00000100:00100000:1.0:1788837950.941707:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037066240 00000100:00100000:1.0:1788837950.941713:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037066240 00000100:00100000:1.0:1788837950.941751:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037066112 00000100:00100000:1.0:1788837950.941753:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037066112 00000100:00100000:1.0:1788837950.941766:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837950.941800:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037066240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788837950.941842:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788837950.941884:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037066240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (4915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837950.941891:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837950.941907:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837950.941912:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037066112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788837950.941925:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788837950.941949:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037066112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837950.941966:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837950.942008:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037066368:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788837950.942048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837950.942064:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037066496:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788837950.942081:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837950.942272:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037065728 00000100:00100000:0.0:1788837950.942279:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037065728 00000100:00100000:0.0:1788837950.942445:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037065600 00000100:00100000:0.0:1788837950.942450:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037065600 00000100:00100000:0.0:1788837950.942471:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788837950.942478:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732037065728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837950.942518:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732037065728:12345-0@lo:400:kworker.0 Request processed in 40us (6411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837950.942523:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788837950.942538:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788837950.942541:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875732037065600:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788837950.942546:0:19205:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788837950.942571:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875732037065600:12345-0@lo:400:kworker.0 Request processed in 28us (5393us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788837950.942575:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788837950.942763:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788837950.943135:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff889affc4d180 x1875732037065728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837950.943156:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732037065728:0@lo:400:kworker.0 00000100:00100000:2.0:1788837950.943181:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037066240:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788837950.943213:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788837950.943218:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8899c4400000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788837950.943221:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788837950.943226:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8899c4400000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837950.943230:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 504 00000100:00080000:2.0:1788837950.943235:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8899c4400000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837950.943370:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5fce00 x1875732037066624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837950.943385:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732037065600:0@lo:400:kworker.0 00000100:00100000:2.0:1788837950.943403:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037066112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837950.944002:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4ba9880 x1875732037066752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837950.944117:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732037065472:0@lo:400:kworker.0 00010000:00080000:0.0:1788837950.944136:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff889affc4d500 x1875732037065984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837950.944145:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732037065984:0@lo:400:kworker.0 00000100:00100000:0.0:1788837950.944404:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037066496 00000100:00100000:0.0:1788837950.944410:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037066496 00000100:00100000:0.0:1788837950.944510:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788837950.944517:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875732037066496:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788837950.944535:0:19205:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788837950.945189:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037066624:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788837950.945365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837950.945401:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875732037066752:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788837950.945474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837950.945514:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037066368 00000100:00100000:1.0:1788837950.945519:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037066368 00000100:00100000:1.0:1788837950.945546:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837950.945551:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875732037066368:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788837950.945563:0:18161:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788837950.945602:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875732037066368:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 50us (3553us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837950.945609:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788837950.945645:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ac85f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837950.945650:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788837950.945653:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037066368:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788837950.946116:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037066624 00000100:00100000:2.0:1788837950.946122:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037066624 00000100:00100000:2.0:1788837950.946146:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037066752 00000100:00100000:2.0:1788837950.946149:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037066752 00000100:00100000:2.0:1788837950.946161:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788837950.946167:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875732037066624:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788837950.946180:0:17201:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788837950.946221:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875732037066624:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 53us (857us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788837950.946227:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788837950.946373:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788837950.946378:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875732037066752:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788837950.946388:0:17201:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788837950.946414:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875732037066752:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 35us (940us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788837950.946420:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788837950.946524:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c4400000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837950.946529:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788837950.946532:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037066624:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788837950.946553:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8e31000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837950.946556:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788837950.946559:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875732037066752:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788837950.987402:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875732037066496:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 42877us (45312us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837950.987424:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788837950.987987:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889affb4d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837950.987994:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788837950.987998:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037066496:0@lo:38:ptlrpcd_00_02.0 00000040:00080000:1.0:1788837951.356942:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788837951.803432:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837952.827425:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837953.856271:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788837953.991308:0:19523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788837953.991319:0:19523:0:(genops.c:885:class_export_put()) final put ffff8899c4402800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788837953.991348:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c4402800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788837953.991394:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c4406800 for lustre-OST0001 00000020:01000004:0.0:1788837954.441465:0:20974:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788837954.462946:0:20974:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788837954.463020:0:20974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.463035:0:20974:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.463043:0:20974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.463050:0:20974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.463095:0:20974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788837954.463101:0:20974:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788837954.463131:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788837954.463135:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788837954.463141:0:20974:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788837954.463147:0:20974:0:(import.c:65:import_set_state_nolock()) ffff889af8e31000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788837954.463152:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788837954.463154:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788837954.463156:0:20974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788837954.464053:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837954.464064:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837954.464074:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837954.464077:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837954.464097:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837954.464105:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837954.464112:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788837954.464114:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788837954.464117:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788837954.464163:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837954.464170:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837954.464209:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837954.464216:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837954.464240:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837954.464242:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837954.464244:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837954.464403:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837954.464424:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037066880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837954.464487:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837954.465197:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037066880 00000100:00100000:3.0:1788837954.465206:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037066880 00000100:00100000:3.0:1788837954.465256:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837954.465263:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875732037066880:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788837954.465270:0:17186:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837954 with bad export cookie 6338487623412023468 00010000:00010000:0.0:1788837954.469416:0:20974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469437:0:20974:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469444:0:20974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469451:0:20974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469472:0:20974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837954.469478:0:20974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469484:0:20974:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469510:0:20974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469516:0:20974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469526:0:20974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788837954.469533:0:20974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469539:0:20974:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469545:0:20974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469552:0:20974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469576:0:20974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788837954.469581:0:20974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469587:0:20974:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469591:0:20974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469606:0:20974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837954.469613:0:20974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788837954.469617:0:20974:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788837954.469652:0:20974:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788837954.469656:0:20974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788837954.469660:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837954.469664:0:20974:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788837954.469671:0:20974:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8899c4401800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837954.469677:0:20974:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8899c2778800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837954.469682:0:20974:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff889ac848cd28) has exports, disconnecting them 00000020:00080000:0.0:1788837954.469686:0:20974:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8899c4401800), last request at 1788837950 00000020:00000080:0.0:1788837954.469693:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af04bf 00000100:00080000:0.0:1788837954.469708:0:20974:0:(import.c:65:import_set_state_nolock()) ffff8899c4405000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788837954.469766:0:20974:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c4401800): rc 0 00000020:00000080:0.0:1788837954.469769:0:20974:0:(genops.c:885:class_export_put()) final put ffff8899c4401800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788837954.469793:0:20974:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8899c2778800), last request at 1788837950 00000020:00000080:0.0:1788837954.469796:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0361 00000100:00080000:0.0:1788837954.469801:0:20974:0:(import.c:65:import_set_state_nolock()) ffff8899c277b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788837954.469807:0:20974:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c2778800): rc 0 00000020:00000080:0.0:1788837954.469809:0:20974:0:(genops.c:885:class_export_put()) final put ffff8899c2778800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788837954.469815:0:20974:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa3bc81dcfae0 00000100:00080000:0.0:1788837954.469833:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788837954.469836:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788837954.470305:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788837954.470313:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470322:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9ae00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837954.470326:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470334:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837954.470341:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837954.470347:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837954.470349:0:17953:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1788837954.470352:0:17953:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1788837954.470394:0:17953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470400:0:17953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837954.470420:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470425:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470439:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788837954.470442:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470447:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837954.470449:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470455:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837954.470461:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837954.470465:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837954.470467:0:17953:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788837954.470469:0:17953:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788837954.470477:0:17953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470482:0:17953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837954.470494:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470505:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470517:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837954.470521:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470526:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9400 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837954.470528:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470534:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837954.470540:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837954.470544:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788837954.470546:0:17953:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788837954.470548:0:17953:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788837954.470560:0:17953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470565:0:17953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837954.470570:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470576:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470592:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837954.470595:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470600:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9bc00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837954.470602:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470608:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837954.470614:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837954.470619:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837954.470621:0:17953:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788837954.470622:0:17953:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788837954.470635:0:17953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470640:0:17953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837954.470646:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470651:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837954.470662:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837954.470664:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837954.470673:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788837954.470683:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c4401800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788837954.470723:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c2778800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788837954.470743:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c4405000 for lustre-MDT0001 00000020:00000080:2.0:1788837954.470758:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c277b800 for lustre-MDT0001 00000100:00100000:2.0:1788837954.470793:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037067136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837954.470859:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837954.470909:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837954.470915:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037067264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837954.470936:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837954.470982:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037067136 00000100:00100000:2.0:1788837954.470989:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037067136 00000100:00100000:2.0:1788837954.471017:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037067264 00000100:00100000:2.0:1788837954.471020:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037067264 00000100:00100000:2.0:1788837954.471032:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788837954.471038:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875732037067136:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788837954.471044:0:20228:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837954 with bad export cookie 6338487623412023468 00000100:00100000:2.0:1788837954.471085:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875732037067136:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (226us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788837954.471104:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788837954.471120:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837954.471124:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875732037067264:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788837954.471129:0:20228:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837954 with bad export cookie 6338487623412023468 00000100:00100000:2.0:1788837954.471150:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875732037067264:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (214us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788837954.471156:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837954.471174:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037067392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837954.471830:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837954.471853:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837954.471859:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037067008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837954.471877:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837954.471899:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037067392 00000100:00100000:2.0:1788837954.471903:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037067392 00000100:00100000:2.0:1788837954.471916:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037067008 00000100:00100000:2.0:1788837954.471918:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037067008 00000100:00100000:2.0:1788837954.471927:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837954.471932:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1875732037067392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788837954.471936:0:17187:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837954 with bad export cookie 6338487623412023468 00000100:00100000:2.0:1788837954.471974:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1875732037067392:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (143us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788837954.471980:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837954.471991:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788837954.471995:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1875732037067008:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788837954.471998:0:17187:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837954 with bad export cookie 6338487623412023468 00000100:00100000:2.0:1788837954.472016:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1875732037067008:12345-0@lo:103:ldlm_bl.0 Request processed in 21us (139us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788837954.472021:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788837954.472045:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788837954.472050:0:3650:0:(import.c:65:import_set_state_nolock()) ffff889af8dff800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788837954.472053:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1788837954.472295:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837954.473819:0:20974:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788837954.473827:0:20974:0:(import.c:65:import_set_state_nolock()) ffff889ac85f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788837954.476422:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788837954.476429:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788837954.476450:0:20974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788837954.476503:0:20974:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788837954.476530:0:20974:0:(import.c:65:import_set_state_nolock()) ffff889ad9a71000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788837954.476545:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788837954.476547:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788837954.476560:0:20974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788837954.476608:0:20974:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788837954.476616:0:20974:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788837954.476653:0:20974:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff889ac848cd28) has no exports 00000100:00100000:0.0:1788837954.477914:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037067520:0@lo:9:umount.0 00000100:00100000:0.0:1788837954.478006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837954.478066:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037067648:0@lo:9:umount.0 00000100:00100000:1.0:1788837954.478184:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037067520 00000100:00100000:1.0:1788837954.478193:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037067520 00000100:00100000:1.0:1788837954.478258:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837954.478274:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875732037067520:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788837954.478300:0:18709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af038b 00000100:00080000:1.0:1788837954.478308:0:18709:0:(import.c:65:import_set_state_nolock()) ffff8899c4404800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837954.478351:0:18709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788837954.478488:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3647:x1875732037067520:12345-0@lo:9:umount.0 Request processed in 216us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837954.478496:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788837954.478717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788837954.478797:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad9a71000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788837954.478808:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788837954.478810:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788837954.478813:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037067520:0@lo:9:umount.0 00000100:00080000:0.0:1788837954.478837:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837954.478888:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037067648 00000100:00100000:1.0:1788837954.478892:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037067648 00000100:00100000:1.0:1788837954.478932:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837954.478940:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875732037067648:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788837954.478966:0:18707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af04f0 00000100:00080000:1.0:1788837954.478972:0:18707:0:(import.c:65:import_set_state_nolock()) ffff8899c4406000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837954.478995:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788837954.479079:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3647:x1875732037067648:12345-0@lo:9:umount.0 Request processed in 140us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837954.479233:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788837954.479260:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788837954.479293:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837954.479313:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788837954.479317:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788837954.479319:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788837954.479322:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037067648:0@lo:9:umount.0 00000100:00080000:0.0:1788837954.479907:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1788837954.480639:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837954.481157:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875732037066880:12345-0@lo:103:ldlm_bl.0 Request processed in 15890us (16667us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788837954.481167:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788837954.481223:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788837954.499570:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.103@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788837954.499578:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788837954.499588:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889afc3f6a00 x1875732037064960/t0(0) o400->MGC192.168.201.103@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788837966 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837954.499628:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4bace00 x1875732037066880/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837970 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837954.499637:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889afa5fce00 x1875732037067136/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837970 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837954.499647:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889afa5fc380 x1875732037067264/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837970 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837954.499656:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889afa5ffb80 x1875732037067392/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837970 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837954.499664:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889afa5fe300 x1875732037067008/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837970 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788837954.499672:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788837954.499674:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788837954.499676:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788837954.504899:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff889af8dff800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788837954.504940:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037067136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837954.504984:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037067264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837954.505007:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837954.505518:0:3651:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff889af8dff800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:2.0:1788837954.505523:0:3650:0:(import.c:65:import_set_state_nolock()) ffff889af8dff800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837954.505529:0:3650:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 470 00000100:00100000:3.0:1788837954.505535:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037064960:0@lo:400:kworker.0 00000100:00080000:2.0:1788837954.505538:0:3650:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import ffff889af8dff800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837954.505553:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037066880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837954.505600:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4d180 x1875732037067776/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837954.505634:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037067392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837954.505646:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037067008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837954.506311:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3647:1875732037067776:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788837954.506349:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875732037067776 offset 0 length 520: 4 00000020:00080000:1.0:1788837954.523947:0:20974:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff889ac848cd28) has no exports 00000020:01000000:0.0:1788837954.614366:0:20974:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8899c327eba0 - data ffff889ae52fdbd0/ffff8899c26c6c00 00000020:01000000:2.0:1788837954.614581:0:20974:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889ac44170c0 - data ffff889ae5013d80/ffff889aec347400 00000001:00000004:2.0:1788837954.662920:0:20974:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:1.0:1788837954.739027:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788837954.739037:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788837954.739045:0:20974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788837954.744934:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788837954.744943:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788837954.747351:0:20974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837954.747354:0:20974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788837954.747674:0:17941:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788837954.747678:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1788837954.747689:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788837954.749380:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788837954.749389:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788837954.749411:0:20974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837954.749429:0:20974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788837954.750249:0:17943:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788837954.750253:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1788837954.750274:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788837954.761516:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af01f5 00000020:00000080:1.0:1788837954.761530:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ac85f7000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788837954.762112:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac85f7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788837954.773060:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af020a 00000020:00000080:1.0:1788837954.773075:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ac85f3800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788837954.773091:0:20974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788837954.773097:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837954.773275:0:20974:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788837954.773281:0:20974:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff889afc3fcd28) has no exports 00000004:01000000:1.0:1788837954.773467:0:20974:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788837954.773477:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af025e 00000020:00000080:1.0:1788837954.773483:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ae7d3c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788837954.773487:0:20974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788837954.773490:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837954.773495:0:20974:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788837954.773498:0:20974:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff889ac857cd28) has no exports 00000020:00000080:1.0:1788837954.773503:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0257 00000020:00000080:1.0:1788837954.773507:0:20974:0:(genops.c:885:class_export_put()) final put ffff889af8db8000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788837954.773906:0:20974:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788837954.773911:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788837954.773915:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788837954.773921:0:20974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837954.773923:0:20974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788837954.774050:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac85f3800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788837954.774064:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7d3c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788837954.774069:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8db8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788837954.774074:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889af8dbc000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788837954.774942:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837954.775021:0:20974:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788837954.775025:0:20974:0:(genops.c:885:class_export_put()) final put ffff889af8dbd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788837954.775029:0:20974:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8dbd800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788837954.775034:0:20974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788837954.775279:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0249 00000020:00000080:1.0:1788837954.775286:0:20974:0:(genops.c:885:class_export_put()) final put ffff889af8db9000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788837954.775339:0:20974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788837954.775344:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837954.775361:0:20974:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788837954.775365:0:20974:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff889af99acd28) has no exports 00000020:00000080:1.0:1788837954.775371:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0242 00000020:00000080:1.0:1788837954.775375:0:20974:0:(genops.c:885:class_export_put()) final put ffff889adea4b800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788837954.780399:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8db9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788837954.781594:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889adea4b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788837954.787338:0:20974:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788837954.787347:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788837954.787351:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788837954.787359:0:20974:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837954.787362:0:20974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788837954.787413:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837954.787426:0:20974:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788837954.787454:0:20974:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788837954.787461:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af022d 00000020:00000080:1.0:1788837954.787471:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ad20f6800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788837954.787476:0:20974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788837954.787484:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837954.787488:0:20974:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788837954.787492:0:20974:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff889ac85799b8) has no exports 00000020:00000080:1.0:1788837954.787499:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0226 00000020:00000080:1.0:1788837954.787502:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ad20f1000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788837954.787867:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ad9a71000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788837954.787876:0:37:0:(genops.c:885:class_export_put()) final put ffff889ac2c5b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788837954.787879:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac2c5b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788837954.787885:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788837954.787978:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad20f6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788837954.787985:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad20f1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788837954.796908:0:20974:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788837954.796921:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837954.796926:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788837954.796933:0:20974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788837954.796963:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ac85f6800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788837954.796990:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837954.797004:0:20974:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788837954.797011:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ad20f3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788837954.797017:0:20974:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad20f3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788837954.797029:0:20974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788837954.797654:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837954.797661:0:20974:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788837954.797665:0:20974:0:(genops.c:885:class_export_put()) final put ffff889aded38800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788837954.797668:0:20974:0:(genops.c:844:class_export_destroy()) destroying export ffff889aded38800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788837954.797678:0:20974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788837954.797827:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0211 00000020:00000080:3.0:1788837954.797834:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ac85f0800/lustre-MDD0001_UUID 00000020:01000000:3.0:1788837954.797848:0:20974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788837954.797852:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837954.797858:0:20974:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788837954.797862:0:20974:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff889ac8488000) has no exports 00000020:00000080:3.0:1788837954.797891:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837954.797896:0:20974:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788837954.797901:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0218 00000020:00000080:3.0:1788837954.797906:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ac85f1000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788837954.797915:0:20974:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ac444e800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788837954.797919:0:20974:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac444e800 2 00000020:01000004:3.0:1788837954.797922:0:20974:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889ac444e800 from lustre-MDT0001 00000020:00000080:3.0:1788837954.797942:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837954.798243:0:20974:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788837954.798247:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ac85f3000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788837954.798249:0:20974:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac85f3000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788837954.798260:0:20974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788837954.798298:0:20974:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788837954.798302:0:20974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788837954.798304:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837954.798308:0:20974:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788837954.798316:0:20974:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff889af8e32000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837954.798321:0:20974:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff889ae7f399b8) has exports, disconnecting them 00000020:00080000:3.0:1788837954.798326:0:20974:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff889af8e32000), last request at 1788837869 00000020:00000080:3.0:1788837954.798330:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0296 00000020:00080000:3.0:1788837954.798344:0:20974:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889af8e32000): rc 0 00000020:00000080:3.0:1788837954.798348:0:20974:0:(genops.c:885:class_export_put()) final put ffff889af8e32000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788837954.802139:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac85f0800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788837954.802161:0:37:0:(genops.c:885:class_export_put()) final put ffff889ac85f4800/lustre-MDD0001_UUID 00000020:00000080:2.0:1788837954.802164:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac85f4800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788837954.802174:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788837954.802361:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac85f1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788837954.802368:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8e32000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788837954.805166:0:20974:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788837954.805191:0:20974:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837954.805196:0:20974:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788837954.805204:0:20974:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788837954.805231:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889af8e31000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788837954.805406:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837954.805416:0:20974:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788837954.805422:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ad9a74800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788837954.805426:0:20974:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad9a74800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788837954.805431:0:20974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788837954.805520:0:20974:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac444e800 1 00000020:00000080:2.0:1788837954.805526:0:20974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af01bd 00000020:00000080:2.0:1788837954.805532:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ac4448800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788837954.805541:0:20974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788837954.805560:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac4448800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788837954.805569:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837954.805575:0:20974:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788837954.805580:0:20974:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff889af99a8000) has no exports 00010000:00010000:1.0:1788837954.948017:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788837955.007544:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837955.007561:0:20974:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788837955.007568:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ac444d800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788837955.007573:0:20974:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac444d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788837955.007584:0:20974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788837955.007699:0:20974:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff889ac444b000 00000020:01000000:2.0:1788837955.007719:0:20974:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788837955.007723:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837955.007727:0:20974:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788837955.007730:0:20974:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8899c266cd28) has no exports 00000100:00100000:0.0:1788837955.008964:0:19205:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8899c3e12000:19205] 3 exiting: rc = 0 00000100:00100000:0.0:1788837955.009073:0:17201:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8899c351dc00:17201] 1 exiting: rc = 0 00000100:00100000:3.0:1788837955.009359:0:17202:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8899c3217200:17202] 2 exiting: rc = 0 00000100:00100000:1.0:1788837955.009669:0:17200:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff889ac4fee400:17200] 0 exiting: rc = 1 00000100:00100000:2.0:1788837955.009810:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009819:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009824:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009829:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009835:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009840:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009845:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009850:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009855:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009869:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009875:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009880:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009886:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009891:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009896:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009902:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009906:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009911:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009916:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009921:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009940:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009946:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009952:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009958:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009963:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009968:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009974:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009981:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009987:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009992:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.009998:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010004:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010010:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010015:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010020:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010025:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010031:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010037:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010042:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010047:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010052:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010060:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010066:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010071:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010077:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010082:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010089:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010094:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010100:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010106:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010111:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010116:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010120:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010125:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010130:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010148:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010155:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010161:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010364:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010372:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010379:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010384:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010390:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.010395:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.017212:0:17204:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8899c3217e00:17204] 1 exiting: rc = 0 00000100:00100000:1.0:1788837955.017415:0:17203:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8899c3216200:17203] 0 exiting: rc = 1 00000100:00100000:2.0:1788837955.017487:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017496:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017502:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017507:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017812:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017820:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017825:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017830:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017935:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017940:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017945:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017950:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017955:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017960:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017965:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017971:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017976:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017981:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017986:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017991:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.017997:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018002:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018007:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018012:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018017:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018023:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018042:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018048:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018053:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018058:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018064:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018069:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018074:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018078:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018083:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018089:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018094:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018098:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018103:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018108:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018113:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018117:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018121:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018126:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018130:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018136:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018141:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018146:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018152:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018157:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018163:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018168:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018174:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018180:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018185:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018189:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018194:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018198:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018203:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018208:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018212:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018224:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018228:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.018233:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.019576:0:17206:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8899c351d600:17206] 1 exiting: rc = 0 00000100:00100000:1.0:1788837955.019987:0:18161:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8899c243ce00:18161] 2 exiting: rc = 0 00000100:00100000:2.0:1788837955.020150:0:17205:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff889ac8532400:17205] 0 exiting: rc = 1 00000100:00100000:3.0:1788837955.020274:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020281:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020287:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020293:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020299:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020306:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020313:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020332:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020340:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020347:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020355:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020360:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020367:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020372:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020378:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020384:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020389:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020395:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020401:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020420:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020426:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020440:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020446:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020452:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020457:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020463:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020469:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020475:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020481:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020487:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020492:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020511:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020569:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020575:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020638:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020647:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020652:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020658:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020664:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020670:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020675:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020681:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020687:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020705:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020712:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020718:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020724:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020729:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020735:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020751:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020756:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020763:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020770:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.020993:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.021002:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.021021:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.021033:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.021039:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.021045:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.021051:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.021057:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.021062:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.021068:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837955.021074:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.039930:0:17207:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff889ad868c600:17207] 0 exiting: rc = 1 00000100:00100000:1.0:1788837955.040024:0:17208:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff889ad868ce00:17208] 1 exiting: rc = 0 00000100:00100000:2.0:1788837955.040413:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040421:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040426:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040432:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040437:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040442:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040447:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040452:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040457:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040462:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040467:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040472:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040476:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040482:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040486:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040491:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040497:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040502:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040507:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040511:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040528:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040532:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040537:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040542:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040546:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040551:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040556:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040561:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040566:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040571:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040576:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040603:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040608:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040612:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040617:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040622:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040627:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040632:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040637:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040643:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040648:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040654:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040659:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040664:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040669:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040674:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040679:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040684:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040689:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040694:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040699:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040704:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040708:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040713:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040717:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040722:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040726:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040732:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040746:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040752:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040757:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040762:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040767:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837955.040772:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045226:0:17209:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8899c36cec00:17209] 0 exiting: rc = 1 00000100:00100000:1.0:1788837955.045430:0:17210:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8899c36cf600:17210] 1 exiting: rc = 0 00000100:00100000:0.0:1788837955.045547:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045555:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045575:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045580:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045586:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045604:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045609:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045614:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045618:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045623:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045628:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045633:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045638:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045642:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045647:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045651:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045656:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045661:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045666:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045671:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045676:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045681:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045686:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045691:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045696:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045701:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045706:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045711:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045717:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045722:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045727:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045732:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045746:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045752:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045757:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045762:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045768:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045806:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045811:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045816:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045821:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045827:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045841:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045846:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045850:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045855:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045859:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045864:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045869:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045875:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045880:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045885:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045890:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045895:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045900:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045904:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045908:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045913:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045916:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045921:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045926:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045930:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045934:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.045939:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046295:0:17211:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8899c2534400:17211] 0 exiting: rc = 1 00000100:00100000:1.0:1788837955.046502:0:17212:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8899c2535c00:17212] 1 exiting: rc = 0 00000100:00100000:0.0:1788837955.046654:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046660:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046666:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046670:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046675:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046680:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046685:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046700:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046704:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046709:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046714:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046719:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046725:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046730:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046748:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046755:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046760:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046765:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046771:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046800:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046807:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046812:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046817:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046823:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046886:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046894:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046898:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046903:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046907:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046913:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046918:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046923:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046928:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046932:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046938:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046942:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046946:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046951:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046955:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046960:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046965:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046969:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046983:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046988:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046993:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.046998:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047003:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047008:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047013:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047017:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047022:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047027:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047032:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047037:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047043:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047047:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047052:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047057:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047061:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047066:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047070:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047075:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047079:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047084:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837955.047560:0:17215:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff889adf792000:17215] 2 exiting: rc = 0 00000100:00100000:1.0:1788837955.047845:0:17213:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8899c3de3600:17213] 0 exiting: rc = 1 00000100:00100000:2.0:1788837955.048128:0:17214:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8899c3de2400:17214] 1 exiting: rc = 0 00000100:00100000:1.0:1788837955.049307:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049331:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049337:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049343:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049349:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049355:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049360:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049366:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049372:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049378:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049384:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049389:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049396:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049401:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049407:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049412:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049418:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049439:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049446:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049452:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049457:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049462:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049468:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049474:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049480:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049486:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049491:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049496:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049502:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049508:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049526:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049533:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049539:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049545:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049551:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049557:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049570:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049575:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049589:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049596:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049601:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049621:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049627:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049632:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049637:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049643:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049648:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049653:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049658:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049663:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049668:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049674:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049679:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049684:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049689:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049694:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049699:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049705:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049710:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049715:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049731:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049748:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049754:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837955.049760:0:20974:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788837955.054428:0:20974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837955.054442:0:20974:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788837955.054448:0:20974:0:(genops.c:885:class_export_put()) final put ffff889ad179a800/MDS_uuid 00000020:00000080:1.0:1788837955.054452:0:20974:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad179a800/MDS_uuid for MDS 00000020:01000000:1.0:1788837955.054458:0:20974:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788837955.054629:0:20974:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788837955.961053:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788837956.028922:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837956.028932:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788837956.028935:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837956.028938:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788837956.028942:0:37:0:(import.c:65:import_set_state_nolock()) ffff8899c4400000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837956.028950:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 567 00000100:00080000:0.0:1788837956.028955:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788837956.028962:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8899c4400000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788837956.029006:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4ba9c00 x1875732037067904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788837956.029066:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837956.029069:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788837956.029070:0:37:0:(import.c:65:import_set_state_nolock()) ffff889affb4d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837956.029073:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 567 00000100:00080000:0.0:1788837956.029075:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788837956.029078:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff889affb4d000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837956.029165:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732037068032:0@lo:400:kworker.0 00000400:00000100:3.0:1788837956.029218:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037068032 offset 0 length 224: 4 00000100:00100000:1.0:1788837956.029336:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037067904:0@lo:38:kworker.0 00000400:00000100:1.0:1788837956.029357:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037067904 offset 0 length 520: 4 00000100:00100000:0.0:1788837956.029389:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4ba8700 x1875732037068160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837956.029467:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037068160:0@lo:38:kworker.0 00000400:00000100:1.0:1788837956.029486:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037068160 offset 0 length 520: 4 00000100:00100000:3.0:1788837956.029533:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037068288:0@lo:400:kworker.0 00000400:00000100:3.0:1788837956.029555:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037068288 offset 0 length 224: 4 00010000:00010000:0.0:1788837956.992118:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837958.009914:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837959.038360:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788837959.213204:0:21176:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788837959.222135:0:21176:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788837959.222190:0:21176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837959.222205:0:21176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837959.222213:0:21176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837959.222221:0:21176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837959.222245:0:21176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788837959.222249:0:21176:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788837959.222273:0:21176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837959.222298:0:21176:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4ba9c00 x1875732037067904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837971 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837959.222317:0:21176:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788837959.222324:0:21176:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788837959.222330:0:21176:0:(import.c:65:import_set_state_nolock()) ffff8899c4400000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788837959.222335:0:21176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837959.222338:0:21176:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4ba9c00 x1875732037067904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837971 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837959.222346:0:21176:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788837959.222349:0:21176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:0.0:1788837959.222592:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837959.222600:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837959.222602:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037067904:0@lo:38:kworker.0 00010000:00010000:0.0:1788837959.222610:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837959.222614:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837959.222628:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837959.222637:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837959.222643:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788837959.222645:0:17953:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788837959.222655:0:17953:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788837959.222680:0:17953:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8dff800 00010000:00010000:0.0:1788837959.222685:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837959.222692:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837959.222704:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837959.222705:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837959.222707:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837959.223582:0:21176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837959.223592:0:21176:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4babb80 x1875732037068032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837972 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837959.223769:0:21176:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788837959.223805:0:21176:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788837959.223902:0:21176:0:(import.c:65:import_set_state_nolock()) ffff8899c4403000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788837959.224089:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875732037068416:0@lo:39:umount.0 00000400:00000100:1.0:1788837959.224144:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037068416 offset 0 length 224: 4 00000100:00100000:0.0:1788837959.227161:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732037068032:0@lo:400:kworker.0 00010000:00010000:1.0:1788837960.057346:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837960.058840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837960.058849:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837960.058853:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837960.058856:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788837960.059644:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837960.059680:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037068544:0@lo:400:kworker.0 00000400:00000100:3.0:1788837960.059752:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037068544 offset 0 length 224: 4 00000001:00100000:1.0:1788837960.125500:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788837960.125508:0:18703:0:(genops.c:885:class_export_put()) final put ffff8899c4403800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788837960.125561:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c4403800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788837960.125626:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c4404800 for lustre-OST0000 00000001:00100000:2.0:1788837960.125977:0:19523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788837960.125989:0:19523:0:(genops.c:885:class_export_put()) final put ffff8899c4407000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788837960.126058:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c4407000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788837960.126450:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c4406000 for lustre-OST0001 00000100:00080000:1.0:1788837961.080943:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837961.080956:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837961.080960:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837961.080963:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788837961.081137:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837961.081259:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037068672:0@lo:400:kworker.0 00000400:00000100:0.0:1788837961.081313:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037068672 offset 0 length 224: 4 00010000:00010000:2.0:1788837962.105325:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837963.128953:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837964.153033:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837964.345122:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837954/real 1788837954] req@ffff889affc4d180 x1875732037067776/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788837964 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837964.345165:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889affc4d180 x1875732037067776/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788837964 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788837964.345203:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8dff800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837964.345285:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788837964.345290:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3647:1875732037067776:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1788837964.348606:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837964.348616:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788837964.348620:0:38:0:(import.c:65:import_set_state_nolock()) ffff889af8dff800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837964.348630:0:38:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 571 00000100:00080000:0.0:1788837964.348637:0:38:0:(import.c:589:import_select_connection()) MGC192.168.201.103@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788837964.348644:0:38:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import ffff889af8dff800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788837964.348695:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4babb80 x1875732037068800/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788837964.348727:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837964.348731:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788837964.348902:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732037068928:0@lo:400:kworker.0 00000400:00000100:3.0:1788837964.348957:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037068928 offset 0 length 224: 4 00000100:00100000:2.0:1788837964.349266:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3647:1875732037068800:0@lo:250:kworker.0 00000400:00000100:2.0:1788837964.349292:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875732037068800 offset 0 length 520: 4 00010000:00010000:2.0:1788837965.177005:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837966.201025:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837967.225163:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837968.248980:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837969.275255:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837969.464929:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837959/real 1788837959] req@ffff8899c4bac000 x1875732037068416/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788837969 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837969.464964:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8899c4bac000 x1875732037068416/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788837969 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788837969.464986:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c4403000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788837969.465139:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875732037068416:0@lo:39:umount.0 00000100:00080000:3.0:1788837969.468164:0:21176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837969.471467:0:21176:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788837969.471477:0:21176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788837969.474459:0:21176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.474479:0:21176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.474497:0:21176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.474504:0:21176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.474531:0:21176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837969.474538:0:21176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.474545:0:21176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.474551:0:21176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837969.474557:0:21176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.475460:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837969.475470:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.475478:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837969.475481:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.475501:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837969.475508:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837969.475528:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837969.475530:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788837969.475544:0:17189:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8dff800 00010000:00010000:2.0:1788837969.475548:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.475554:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.475583:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837969.475586:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837969.475588:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837969.476542:0:21176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788837969.476550:0:21176:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788837969.476554:0:21176:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788837969.476705:0:21176:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788837969.476710:0:21176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788837969.476716:0:21176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837969.476731:0:21176:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788837969.476735:0:21176:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff889ae7f38000) has no exports 00000020:00080000:3.0:1788837969.476758:0:21176:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff889ae7f38000) has no exports 00010000:00010000:2.0:1788837969.478789:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837969.478802:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.478813:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8400 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837969.478818:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.478828:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837969.478834:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837969.478840:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788837969.478843:0:17953:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788837969.478846:0:17953:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788837969.478879:0:17953:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8dff800 00010000:00010000:2.0:1788837969.478883:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.478891:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837969.478906:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837969.478908:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837969.478910:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788837969.482752:0:21176:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8899c327e2a0 - data ffff889ae50721b0/ffff889b00c66400 00000020:01000000:3.0:1788837969.483509:0:21176:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8899c30c9480 - data ffff889ae52831b0/ffff8899c1bf4c00 00100000:10000000:3.0:1788837969.495374:0:21176:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788837969.505023:0:21176:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af031b 00000020:00000080:0.0:1788837969.505041:0:21176:0:(genops.c:885:class_export_put()) final put ffff8899c277b000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788837969.505070:0:21176:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ae7d4a800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788837969.505078:0:21176:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ae7d4a800 2 00000020:01000004:0.0:1788837969.505085:0:21176:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889ae7d4a800 from lustre-OST0000 00000020:00000080:0.0:1788837969.505127:0:21176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837969.505142:0:21176:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788837969.505145:0:21176:0:(genops.c:885:class_export_put()) final put ffff8899c277f800/lustre-OST0000_UUID 00000020:00000080:0.0:1788837969.505151:0:21176:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c277f800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788837969.505156:0:21176:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788837969.505205:0:21176:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788837969.505208:0:21176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788837969.505211:0:21176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837969.505215:0:21176:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788837969.505221:0:21176:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8899c4405800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837969.505231:0:21176:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff889ac84899b8) has exports, disconnecting them 00000020:00080000:0.0:1788837969.505236:0:21176:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8899c4405800), last request at 1788837887 00000020:00000080:0.0:1788837969.505239:0:21176:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0345 00000020:00080000:0.0:1788837969.505248:0:21176:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c4405800): rc 0 00000020:00000080:0.0:1788837969.505252:0:21176:0:(genops.c:885:class_export_put()) final put ffff8899c4405800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788837969.505746:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c277b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788837969.505762:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c4405800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788837969.509852:0:21176:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788837969.509862:0:21176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837969.509866:0:21176:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788837969.509873:0:21176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788837969.510063:0:21176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837969.510071:0:21176:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788837969.510079:0:21176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788837969.510085:0:21176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837969.510089:0:21176:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788837969.510096:0:21176:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8899c4402000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788837969.510102:0:21176:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8899c3d33370) has exports, disconnecting them 00000020:00080000:2.0:1788837969.510107:0:21176:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8899c4402000), last request at 1788837887 00000020:00000080:2.0:1788837969.510110:0:21176:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af035a 00000020:00080000:2.0:1788837969.510127:0:21176:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c4402000): rc 0 00000020:00000080:2.0:1788837969.510133:0:21176:0:(genops.c:885:class_export_put()) final put ffff8899c4402000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788837969.511008:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c4400000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788837969.511019:0:37:0:(genops.c:885:class_export_put()) final put ffff889affb4a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788837969.511022:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb4a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788837969.511033:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788837969.511107:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c4402000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788837969.511130:0:21176:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788837969.511134:0:21176:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837969.511136:0:21176:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788837969.511140:0:21176:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788837969.511157:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c4403000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788837969.511284:0:21176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837969.511303:0:21176:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788837969.511307:0:21176:0:(genops.c:885:class_export_put()) final put ffff8899c4401000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788837969.511309:0:21176:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c4401000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788837969.511312:0:21176:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788837969.511338:0:21176:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ae7d4a800 1 00000020:00000080:3.0:1788837969.511342:0:21176:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af02f8 00000020:00000080:3.0:1788837969.511347:0:21176:0:(genops.c:885:class_export_put()) final put ffff889ae7d3f000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788837969.511354:0:21176:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788837969.511362:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7d3f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788837969.511370:0:21176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837969.511374:0:21176:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788837969.511378:0:21176:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff889ac857b370) has no exports 00000020:00000080:3.0:1788837969.729969:0:21176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837969.729983:0:21176:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788837969.729988:0:21176:0:(genops.c:885:class_export_put()) final put ffff889ae7d4e800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788837969.729993:0:21176:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7d4e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788837969.730115:0:21176:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788837969.730332:0:21176:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff889ae7d49800 00000020:02000400:3.0:1788837969.730376:0:21176:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:0.0:1788837969.848923:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837969.848937:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788837969.848940:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837969.848943:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788837969.849051:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037069056:0@lo:400:kworker.0 00000400:00000100:1.0:1788837969.849112:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037069056 offset 0 length 224: 4 00010000:00010000:1.0:1788837970.297034:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837971.323796:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837971.513166:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837956/real 1788837956] req@ffff8899c4ba8700 x1875732037068160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788837971 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837971.513198:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8899c4ba8700 x1875732037068160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788837971 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788837971.513216:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889affb4d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837971.513240:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788837971.513244:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037068160:0@lo:38:kworker.0 00000100:00080000:3.0:1788837971.513313:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837971.513319:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788837971.513321:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837971.513325:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837971.513328:0:38:0:(import.c:65:import_set_state_nolock()) ffff889affb4d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837971.513332:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 572 00000100:00080000:3.0:1788837971.513338:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788837971.513345:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff889affb4d000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837971.513377:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4bace00 x1875732037069184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837971.513438:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037069312:0@lo:400:kworker.0 00000400:00000100:3.0:1788837971.513495:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037069312 offset 0 length 224: 4 00000100:00100000:1.0:1788837971.513675:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037069184:0@lo:38:kworker.0 00000400:00000100:1.0:1788837971.513711:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037069184 offset 0 length 520: 4 00010000:00010000:0.0:1788837972.346062:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788837972.921164:0:3648:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837956/real 1788837956] req@ffff8899c4baa300 x1875732037068288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788837972 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837972.945192:0:3648:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8899c4baa300 x1875732037068288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788837972 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788837972.945209:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8899c3d15800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788837972.945229:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788837972.964694:0:3648:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1788837972.967929:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037068288:0@lo:400:kworker.0 00000100:00080000:2.0:1788837972.969590:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837972.969612:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788837972.969616:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837972.969619:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788837972.969622:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837972.969625:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788837972.969629:0:38:0:(import.c:65:import_set_state_nolock()) ffff8899c3d15800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837972.969647:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 521 00000100:00080000:2.0:1788837972.969657:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8899c3d15800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837972.969697:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4e300 x1875732037069440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837972.969749:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875732037069440:0@lo:38:kworker.0 00000400:00000100:2.0:1788837972.969819:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037069440 offset 0 length 520: 4 00010000:00010000:1.0:1788837973.369956:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788837973.396587:0:21378:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788837973.417065:0:21378:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788837973.417158:0:21378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.417172:0:21378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.417178:0:21378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.417198:0:21378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.417223:0:21378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788837973.417229:0:21378:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788837973.417256:0:21378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837973.417266:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4bace00 x1875732037069184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.417286:0:21378:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788837973.417293:0:21378:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788837973.417298:0:21378:0:(import.c:65:import_set_state_nolock()) ffff889affb4d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788837973.417303:0:21378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837973.417306:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4bace00 x1875732037069184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837991 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.417323:0:21378:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788837973.417326:0:21378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:0.0:1788837973.417412:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037069184:0@lo:38:kworker.0 00010000:00010000:2.0:1788837973.417494:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837973.417501:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.417508:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b200 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837973.417511:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.417519:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837973.417527:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837973.417545:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837973.417558:0:17189:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788837973.417561:0:17189:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788837973.417575:0:17189:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8dff800 00010000:00010000:2.0:1788837973.417580:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.417586:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.417597:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837973.417599:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837973.417601:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837973.419079:0:21378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837973.419094:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889ae7eaaa00 x1875732037068544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837976 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.419114:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889ae7eaa300 x1875732037068672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837977 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.419179:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4ba8a80 x1875732037068928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837980 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.419195:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4ba8000 x1875732037069056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837985 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.419203:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4baca80 x1875732037069312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837987 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.419223:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889affc4e300 x1875732037069440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837982 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.419231:0:21378:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788837973.419254:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037069312:0@lo:400:kworker.0 00000100:00080000:3.0:1788837973.419275:0:21378:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788837973.419279:0:21378:0:(import.c:65:import_set_state_nolock()) ffff8899c3d15800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788837973.419283:0:21378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837973.419285:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889ae7eaaa00 x1875732037068544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837976 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.419293:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889ae7eaa300 x1875732037068672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837977 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837973.419471:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037069056:0@lo:400:kworker.0 00000100:00100000:2.0:1788837973.419522:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732037068928:0@lo:400:kworker.0 00000100:00100000:3.0:1788837973.421268:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4ba8a80 x1875732037068928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837980 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.421283:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4ba8000 x1875732037069056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837985 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.421291:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889affc4e300 x1875732037069440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837982 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837973.421298:0:21378:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788837973.421341:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037068672:0@lo:400:kworker.0 00000100:00100000:1.0:1788837973.421390:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037068544:0@lo:400:kworker.0 00000100:00100000:3.0:1788837973.422034:0:21378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:1.0:1788837973.422111:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875732037069440:0@lo:38:kworker.0 00010000:00010000:3.0:1788837973.424027:0:21378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.424045:0:21378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.424053:0:21378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.424074:0:21378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.424143:0:21378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837973.424152:0:21378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.424159:0:21378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.424165:0:21378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837973.424171:0:21378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.424242:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837973.424251:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.424258:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837973.424262:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.424271:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837973.424278:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837973.424284:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788837973.424287:0:17953:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788837973.424299:0:17953:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8dff800 00010000:00010000:0.0:1788837973.424302:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.424308:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.424390:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837973.424393:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.424398:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837973.424401:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.424429:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837973.424436:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837973.424441:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788837973.424443:0:17953:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788837973.424448:0:17953:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8dff800 00010000:00010000:0.0:1788837973.424450:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837973.424457:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837973.424459:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837973.424461:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837973.424496:0:21378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788837973.424500:0:21378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837973.424516:0:21378:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788837973.424521:0:21378:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788837973.424523:0:21378:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1788837973.425487:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788837973.425537:0:21378:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788837973.425542:0:21378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788837973.425601:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837973.425609:0:21378:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788837973.425613:0:21378:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff889ae7f3b370) has no exports 00000020:00080000:3.0:1788837973.425752:0:21378:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff889ae7f3b370) has no exports 00000020:01000000:3.0:1788837973.430142:0:21378:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8899c327e000 - data ffff889ae52800d8/ffff889afbea8c00 00000020:01000000:3.0:1788837973.430299:0:21378:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8899c327ea20 - data ffff8899c1ccad80/ffff8899c24d0c00 00100000:10000000:2.0:1788837973.442142:0:21378:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788837973.449332:0:21378:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af0479 00000020:00000080:2.0:1788837973.449343:0:21378:0:(genops.c:885:class_export_put()) final put ffff8899c3d13800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788837973.449362:0:21378:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8899c36d1800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788837973.449366:0:21378:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8899c36d1800 2 00000020:01000004:2.0:1788837973.449369:0:21378:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8899c36d1800 from lustre-OST0001 00000020:00000080:2.0:1788837973.449395:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837973.449404:0:21378:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788837973.449407:0:21378:0:(genops.c:885:class_export_put()) final put ffff8899c3d17000/lustre-OST0001_UUID 00000020:00000080:2.0:1788837973.449409:0:21378:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3d17000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788837973.449427:0:21378:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788837973.449516:0:21378:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS 00010000:00010000:2.0:1788837973.449530:0:21378:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af01c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af01cb expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837973.449553:0:21378:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af01c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af01cb expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837973.449559:0:21378:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788837973.449562:0:21378:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788837973.449565:0:21378:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788837973.449579:0:21378:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8dff800 00010000:00010000:2.0:1788837973.449583:0:21378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af01c4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af01cb expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837973.449598:0:21378:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837973.449603:0:21378:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837973.449608:0:21378:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837973.449610:0:21378:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788837973.449611:0:21378:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788837973.449617:0:21378:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8dff800 00010000:00010000:2.0:1788837973.449834:0:21378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788837973.449960:0:21378:0:(import.c:65:import_set_state_nolock()) ffff889af8dff800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788837973.449964:0:21378:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788837973.449966:0:21378:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788837973.449967:0:21378:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788837973.449971:0:21378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788837973.449982:0:21378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c4babb80 x1875732037068800/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788837979 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788837973.450007:0:21378:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788837973.450009:0:21378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:1.0:1788837973.450078:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3d13800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788837973.450116:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3647:1875732037068800:0@lo:250:kworker.0 10000000:01000000:2.0:1788837973.450183:0:21378:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788837973.450190:0:21378:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af009e 00000020:00000080:2.0:1788837973.450195:0:21378:0:(genops.c:885:class_export_put()) final put ffff889ad1799800/d42f6ebb-a489-4c0b-be2b-e965e16a506d 00000020:01000000:2.0:1788837973.450209:0:21378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.103@tcp (flags='') 00000020:00000080:2.0:1788837973.450214:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837973.450218:0:21378:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788837973.450222:0:21378:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8899c364b370) has no exports 00000020:00000080:1.0:1788837973.450267:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad1799800/d42f6ebb-a489-4c0b-be2b-e965e16a506d for MGC192.168.201.103@tcp 10000000:01000000:3.0:1788837973.450411:0:17197:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788837973.450516:0:21378:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.103@tcp: client import never connected 00000100:00080000:2.0:1788837973.450520:0:21378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788837973.450522:0:21378:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788837973.450524:0:21378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788837973.450526:0:21378:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788837973.450567:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837973.450572:0:21378:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.103@tcp (uuid d42f6ebb-a489-4c0b-be2b-e965e16a506d) 00000020:01000000:2.0:1788837973.450576:0:21378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788837973.450580:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837973.450583:0:21378:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788837973.450588:0:21378:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8899c4404000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788837973.450593:0:21378:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8899c3d319b8) has exports, disconnecting them 00000020:00080000:2.0:1788837973.450597:0:21378:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8899c4404000), last request at 1788837904 00000020:00000080:2.0:1788837973.450601:0:21378:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af04a3 00000020:00080000:2.0:1788837973.450611:0:21378:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c4404000): rc 0 00000020:00000080:2.0:1788837973.450614:0:21378:0:(genops.c:885:class_export_put()) final put ffff8899c4404000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788837973.450750:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889af8dff800 for MGC192.168.201.103@tcp 00000020:00000080:1.0:1788837973.450757:0:38:0:(genops.c:885:class_export_put()) final put ffff889af8dfa800/d42f6ebb-a489-4c0b-be2b-e965e16a506d 00000020:00000080:1.0:1788837973.450760:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8dfa800/d42f6ebb-a489-4c0b-be2b-e965e16a506d for MGC192.168.201.103@tcp 00000020:01000000:1.0:1788837973.450764:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.103@tcp (d42f6ebb-a489-4c0b-be2b-e965e16a506d) 00000020:00000080:1.0:1788837973.451156:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c4404000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788837973.469195:0:21378:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788837973.469205:0:21378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837973.469209:0:21378:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788837973.469217:0:21378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788837973.469393:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889affb4d000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788837973.469587:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837973.469597:0:21378:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788837973.469603:0:21378:0:(genops.c:885:class_export_put()) final put ffff8899c4407800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788837973.469607:0:21378:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c4407800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788837973.469618:0:21378:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788837973.470054:0:21378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788837973.470059:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837973.470064:0:21378:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788837973.470071:0:21378:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8899c3d14800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788837973.470077:0:21378:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8899c22c99b8) has exports, disconnecting them 00000020:00080000:2.0:1788837973.470081:0:21378:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8899c3d14800), last request at 1788837904 00000020:00000080:2.0:1788837973.470084:0:21378:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af04b8 00000020:00080000:2.0:1788837973.470097:0:21378:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c3d14800): rc 0 00000020:00000080:2.0:1788837973.470101:0:21378:0:(genops.c:885:class_export_put()) final put ffff8899c3d14800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788837973.474225:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3d14800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788837973.493937:0:21378:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788837973.493947:0:21378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788837973.493952:0:21378:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788837973.493959:0:21378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788837973.494479:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c3d15800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788837973.494582:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788837973.496082:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788837973.496445:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788837973.496837:0:17183:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff889ac2d7b400:17183] 0 exiting: rc = 1 00000100:00100000:3.0:1788837973.497061:0:17184:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff889aded69200:17184] 1 exiting: rc = 0 00000100:00100000:0.0:1788837973.497175:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.497671:0:17185:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff889af8e0ee00:17185] 0 exiting: rc = 1 00000100:00100000:2.0:1788837973.497727:0:17187:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff889aded69c00:17187] 2 exiting: rc = 0 00000100:00100000:1.0:1788837973.498074:0:20228:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff889b00c55600:20228] 3 exiting: rc = 0 00000100:00100000:3.0:1788837973.498243:0:17186:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff889aded68000:17186] 1 exiting: rc = 0 00000100:00100000:0.0:1788837973.498342:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498349:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498356:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498362:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498367:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498374:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498380:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498386:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498390:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498396:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498434:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498440:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498445:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498449:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498453:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498458:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498463:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498467:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498472:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498478:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498483:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498488:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498492:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498498:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498503:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498508:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498513:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498518:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498522:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498528:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498533:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498538:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498543:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498548:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498554:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498559:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498564:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498570:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498575:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498579:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498584:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498588:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498593:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498598:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498602:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498615:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498733:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498742:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498747:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498752:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498759:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498764:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498768:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.498997:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.499006:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.499012:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.499017:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.499022:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.499027:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.499032:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.499038:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.499043:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.499047:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.499052:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788837973.504099:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837973.504112:0:21378:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788837973.504131:0:21378:0:(genops.c:885:class_export_put()) final put ffff8899c3d10800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788837973.504136:0:21378:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3d10800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788837973.504141:0:21378:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788837973.504199:0:21378:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8899c36d1800 1 00000020:00000080:1.0:1788837973.504206:0:21378:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926af045d 00000020:00000080:1.0:1788837973.504212:0:21378:0:(genops.c:885:class_export_put()) final put ffff889af8e35000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788837973.504227:0:21378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788837973.504230:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837973.504235:0:21378:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788837973.504238:0:21378:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff889af99a99b8) has no exports 00000020:00000080:2.0:1788837973.504741:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8e35000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788837973.549144:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837973.549158:0:21378:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788837973.549163:0:21378:0:(genops.c:885:class_export_put()) final put ffff889ad2076000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788837973.549168:0:21378:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad2076000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788837973.549178:0:21378:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788837973.549987:0:21378:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff889ad2073000 00000020:01000000:3.0:1788837973.550010:0:21378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788837973.550015:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837973.550019:0:21378:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788837973.550023:0:21378:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff889ac848b370) has no exports 00000020:00000080:3.0:1788837973.550048:0:21378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837973.550054:0:21378:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788837973.550057:0:21378:0:(genops.c:885:class_export_put()) final put ffff889ae7d3a800/OSS_uuid 00000020:00000080:3.0:1788837973.550060:0:21378:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7d3a800/OSS_uuid for OSS 00000020:01000000:3.0:1788837973.550064:0:21378:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788837973.550216:0:18708:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff889ac9048400:18708] 1 exiting: rc = 0 00000100:00100000:1.0:1788837973.550299:0:19019:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8899c370c000:19019] 3 exiting: rc = 0 00000100:00100000:2.0:1788837973.550424:0:18707:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8899c243dc00:18707] 0 exiting: rc = 1 00000100:00100000:1.0:1788837973.550496:0:18709:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff889af745ee00:18709] 2 exiting: rc = 0 00000100:00080000:0.0:1788837973.550571:0:17196:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788837973.551178:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551186:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551191:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551197:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551201:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551206:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551211:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551217:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551222:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551228:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551235:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551240:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551245:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551264:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551268:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551273:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551278:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551282:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551287:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551292:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551296:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551301:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551305:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551381:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551387:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551393:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551399:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551404:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551409:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551424:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551430:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551435:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551441:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551446:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551451:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551456:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551461:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551467:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551472:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551477:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551482:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551488:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551493:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551498:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551502:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551507:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551512:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551517:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551532:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551537:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.551543:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552086:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552095:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552100:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552106:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552112:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552116:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552122:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552127:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552131:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552136:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552141:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552145:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.552151:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837973.555523:0:20579:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff889ac6916200:20579] 2 exiting: rc = 0 00000100:00100000:0.0:1788837973.557568:0:18710:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff889af9914800:18710] 0 exiting: rc = 1 00000100:00100000:3.0:1788837973.558063:0:18711:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff889af9915000:18711] 1 exiting: rc = 0 00000100:00100000:2.0:1788837973.558397:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558406:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558412:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558426:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558431:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558436:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558441:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558446:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558450:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558455:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558479:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558483:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558488:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558493:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558498:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558503:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558508:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558513:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558518:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558523:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558527:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558533:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558538:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558543:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558548:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558553:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558557:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558562:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558566:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558571:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558576:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558581:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558587:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558593:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558598:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558602:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558608:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558612:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.558618:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559054:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559062:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559067:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559072:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559077:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559082:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559095:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559100:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559105:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559110:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559115:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559120:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559125:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559130:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559136:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559140:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559145:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559150:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559154:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559160:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559164:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559168:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559172:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559177:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.559182:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.561467:0:18713:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff889afb855a00:18713] 1 exiting: rc = 0 00000100:00100000:0.0:1788837973.562163:0:20342:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff889b00c54e00:20342] 3 exiting: rc = 0 00000100:00100000:2.0:1788837973.562597:0:18712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff889afb855400:18712] 0 exiting: rc = 1 00000100:00100000:2.0:1788837973.562769:0:18714:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff889afb854e00:18714] 2 exiting: rc = 0 00000100:00100000:3.0:1788837973.563178:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563187:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563193:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563205:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563211:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563217:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563222:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563229:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563235:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563242:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563247:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563252:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563258:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563263:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563269:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563274:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563279:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563284:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563304:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563319:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563345:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563352:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563357:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563363:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563369:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563375:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563380:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563387:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563393:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563399:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563404:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563409:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563424:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563431:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563437:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563444:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563450:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563455:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563461:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563466:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563471:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563476:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563481:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563486:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563505:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563511:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563516:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563521:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563527:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563532:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563538:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563544:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563550:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563564:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563569:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563574:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563580:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563585:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563590:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563595:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563608:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563615:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563645:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837973.563660:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579234:0:18715:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8899c3de3400:18715] 0 exiting: rc = 1 00000100:00100000:3.0:1788837973.579360:0:18716:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff889ac6c13c00:18716] 1 exiting: rc = 0 00000100:00100000:2.0:1788837973.579494:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579500:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579506:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579511:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579516:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579520:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579525:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579531:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579889:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579898:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579903:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579909:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579929:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579934:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579939:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579945:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579949:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579954:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579959:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579964:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579969:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579974:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579979:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579984:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579990:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.579995:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580000:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580005:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580011:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580016:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580021:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580026:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580031:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580035:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580040:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580045:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580050:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580055:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580060:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580065:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580071:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580076:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580080:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580085:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580090:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580095:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580100:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580112:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580117:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580123:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580128:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580133:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580138:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580143:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580148:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580154:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580165:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580173:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580177:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580182:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580188:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580193:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580198:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.580204:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837973.584168:0:18719:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8899c1b1e600:18719] 1 exiting: rc = 0 00000100:00100000:2.0:1788837973.584185:0:18718:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff889ac6e9bc00:18718] 0 exiting: rc = 1 00000100:00100000:2.0:1788837973.585405:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585424:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585431:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585438:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585444:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585450:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585456:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585462:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585494:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585502:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585508:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585514:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585521:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585527:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585533:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585539:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.585545:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588309:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588315:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588321:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588344:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588350:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588355:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588360:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588366:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588372:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588377:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588382:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588388:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588394:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588399:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588405:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588436:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588442:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588447:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588453:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588459:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588464:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588471:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588477:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588484:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588491:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588496:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588502:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588522:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588530:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588535:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588541:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588556:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588564:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588570:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588576:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588590:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588598:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588605:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.588610:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.590886:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.590903:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.590909:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.590914:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.590921:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.590927:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.590933:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837973.590939:0:21378:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788837973.600756:0:21378:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788837992.556155:0:22141:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788838001.690183:0:22741:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788838001.690190:0:22741:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788838001.690191:0:22741:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788838001.690296:0:22741:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8899c30c6000 00000020:01000004:3.0:1788838001.690312:0:22741:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788838001.690320:0:22741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788838001.690335:0:22741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8899c3d33370) 00000020:00000080:3.0:1788838001.690349:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788838001.747978:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788838001.750468:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.751791:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.752047:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.752289:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.752520:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.752769:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.753530:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.754097:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.754358:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.754576:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.754864:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.755107:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.755369:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.755566:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.756419:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.756753:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.757027:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.757293:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.757518:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.757822:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.758025:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.758242:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.758431:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.758685:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.758970:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.759228:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.759459:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.759707:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.760217:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.761344:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.761660:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.761963:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788838001.762225:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788838001.762925:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788838001.763334:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788838001.763516:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788838001.763761:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.764042:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.765920:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.766301:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788838001.766534:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.766836:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788838001.767282:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.767501:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788838001.767888:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.770861:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.778182:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.778533:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.779017:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.779501:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.780112:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788838001.780354:0:22741:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1788838001.784202:0:22741:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788838001.784426:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788838001.784434:0:22741:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788838001.784445:0:22741:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af0911 00000020:01000004:1.0:1788838001.784462:0:22741:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788838001.784467:0:22741:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788838001.784472:0:22741:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8899c30c6000 from MGS 00000020:01000004:1.0:1788838001.784475:0:22741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788838001.784484:0:22741:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8899c22c99b8) 00000020:00000080:1.0:1788838001.784492:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788838001.784555:0:22741:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8899c30c6000 from MGS, refs=2 00080000:01000000:1.0:1788838001.784559:0:22741:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788838001.784562:0:22741:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af091f 00000100:00100000:1.0:1788838001.784766:0:22741:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788838001.786194:0:22741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788838001.786202:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788838001.787320:0:22741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788838001.787330:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788838001.788552:0:22741:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788838001.789115:0:22741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788838001.789122:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788838001.789690:0:22741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788838001.789697:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788838001.790301:0:22741:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788838001.790308:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788838001.791540:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838001.791545:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838001.791547:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838001.792251:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838001.792254:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838001.792256:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838001.792969:0:22741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788838001.794253:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788838001.807038:0:22741:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788838001.813702:0:22753:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788838001.813817:0:22741:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788838001.813872:0:22741:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788838001.814566:0:22741:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788838001.814903:0:22741:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788838001.815098:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788838001.815104:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788838001.821692:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788838001.821708:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788838001.822260:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788838001.822267:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788838001.823581:0:22758:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788838001.823686:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788838001.823708:0:22741:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.103@tcp' 00000020:01000004:0.0:1788838001.823710:0:22741:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788838001.823740:0:22741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.103@tcp (typ=mgc) 00000020:00000080:0.0:1788838001.823755:0:22741:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.103@tcp (ffff889af99ab370) 00000020:00000080:0.0:1788838001.824224:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788838001.824308:0:22741:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889b00d37000@MGC192.168.201.103@tcp: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788838001.825209:0:22741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.103@tcp-0 is initialized 00000040:01000000:0.0:1788838001.825217:0:22741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788838001.826833:0:22759:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788838001.826937:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.103@tcp (uuid 1072646a-5be5-4430-bdc9-bbcfdd7c0a86) 00000020:00000080:1.0:1788838001.826961:0:22741:0:(genops.c:1385:class_connect()) connect: client 1072646a-5be5-4430-bdc9-bbcfdd7c0a86, cookie 0x57f6d4e926af092d 00000100:00080000:1.0:1788838001.826974:0:22741:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788838001.826981:0:22741:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import ffff889b00d37000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788838001.827014:0:22741:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ae7eaaa00 x1875732037069568/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838001.827042:0:22741:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1072646a-5be5-4430-bdc9-bbcfdd7c0a86->MGS 00000020:01000004:1.0:1788838001.827061:0:22741:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788838001.827066:0:22741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788838001.827079:0:22741:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8899c22c8000) 00000020:00000080:1.0:1788838001.827091:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788838001.829478:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3647:1875732037069568:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788838001.829551:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838001.829820:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037069568 00000100:00100000:2.0:1788838001.829828:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037069568 00000100:00100000:2.0:1788838001.829864:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838001.829871:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3647:x1875732037069568:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788838001.829898:0:22756:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1072646a-5be5-4430-bdc9-bbcfdd7c0a86@0@lo t0 exp 0000000000000000 cur 618 last 0 00000020:00000080:2.0:1788838001.829922:0:22756:0:(genops.c:1385:class_connect()) connect: client 1072646a-5be5-4430-bdc9-bbcfdd7c0a86, cookie 0x57f6d4e926af093b 00000100:00080000:2.0:1788838001.830067:0:22756:0:(import.c:65:import_set_state_nolock()) ffff889ac3ec6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838001.830131:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+5:3647:x1875732037069568:12345-0@lo:250:mount.lustre.0 Request processed in 258us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838001.830139:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788838001.830290:0:3647:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788838001.830298:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.103@tcp: connect to target with instance 0 00000100:00080000:0.0:1788838001.830306:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788838001.830311:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788838001.830314:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889b00d37000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788838001.830316:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788838001.830334:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788838001.830339:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3647:1875732037069568:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788838001.847854:0:22741:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788838001.848111:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788838001.848118:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788838001.865990:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788838001.866012:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788838001.868037:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788838001.868052:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788838001.875344:0:22741:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788838001.875635:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788838001.875641:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788838001.877762:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788838001.877884:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788838001.931606:0:22741:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788838001.932510:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788838001.932518:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788838001.933759:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788838001.933770:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788838001.934479:0:22741:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788838001.934689:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788838001.934694:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788838001.935411:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788838001.935420:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788838001.935942:0:22741:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788838001.936127:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788838001.936236:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788838001.936904:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788838001.936911:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788838001.937589:0:22741:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788838001.937823:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788838001.937829:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788838001.939044:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788838001.939056:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788838001.984160:0:22741:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788838001.984396:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788838001.984403:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788838001.989168:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788838001.989186:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788838001.990391:0:22741:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788838001.990402:0:22741:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788838001.991447:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788838001.991475:0:22741:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788838001.991484:0:22741:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788838001.991609:0:22741:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788838001.991648:0:22741:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.103@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788838001.991653:0:22741:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788838001.991655:0:22741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838001.991656:0:22741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838001.991657:0:22741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838001.991658:0:22741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838001.991660:0:22741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838001.991661:0:22741:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838001.991663:0:22741:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838001.991664:0:22741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838001.991665:0:22741:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788838001.991668:0:22741:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788838001.991670:0:22741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788838001.991671:0:22741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838001.991672:0:22741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838001.991674:0:22741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838001.991675:0:22741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838001.991676:0:22741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838001.991677:0:22741:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838001.991678:0:22741:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838001.991679:0:22741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838001.991680:0:22741:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788838001.991706:0:22741:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788838001.991736:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037069696:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788838001.991837:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838001.991870:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c37489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838001.992115:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037069696 00000100:00100000:2.0:1788838001.992123:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037069696 00000100:00100000:2.0:1788838001.992175:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788838001.992190:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+5:22741:x1875732037069696:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788838001.992234:0:22757:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788838001.992236:0:22757:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788838001.992240:0:22757:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788838001.994647:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788838001.995337:0:22757:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1788838001.997424:0:22779:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788838001.997433:0:22779:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788838001.997436:0:22779:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788838001.997439:0:22779:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788838001.998059:0:22779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788838001.998403:0:22757:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788838001.998415:0:22757:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788838002.001228:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+5:22741:x1875732037069696:12345-0@lo:253:mount.lustre.0 Request processed in 9029us (9381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838002.001247:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838002.001342:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037069696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788838002.001368:0:22741:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788838002.001372:0:22741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788838002.001374:0:22741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838002.001375:0:22741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838002.001376:0:22741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838002.001377:0:22741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838002.001378:0:22741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838002.001380:0:22741:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838002.001381:0:22741:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838002.001383:0:22741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838002.001385:0:22741:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788838002.001404:0:22741:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8899c30c6000 from lustre-MDT0000 10000000:01000000:3.0:1788838002.001434:0:22741:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788838002.001437:0:22741:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788838002.001442:0:22741:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff889af99ab370 10000000:01000000:3.0:1788838002.001447:0:22741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788838002.001619:0:22741:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889af99ab370 from 1 10000000:01000000:3.0:1788838002.001623:0:22741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788838002.001661:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.001671:0:22741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.001680:0:22741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838002.001699:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037069824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838002.001744:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838002.001977:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c37486c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.002198:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037069824 00000100:00100000:2.0:1788838002.002207:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037069824 00000100:00100000:2.0:1788838002.002296:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788838002.002308:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+5:22741:x1875732037069824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838002.002331:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838002.002351:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6dba00/0x57f6d4e926af0949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0942 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.002375:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6dba00/0x57f6d4e926af0949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0942 expref: 6 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.002386:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6dba00/0x57f6d4e926af0949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0942 expref: 6 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.002396:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dba00, rc 0) 00000100:00100000:2.0:1788838002.002490:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+6:22741:x1875732037069824:12345-0@lo:101:mount.lustre.0 Request processed in 184us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.002497:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788838002.002892:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037069824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838002.002910:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.002920:0:22741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838002.003010:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037069952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838002.003044:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838002.003262:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7eae0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838002.003376:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037069952 00000100:00100000:1.0:1788838002.003382:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037069952 00000100:00100000:1.0:1788838002.003457:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788838002.003465:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+6:22741:x1875732037069952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838002.003577:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+6:22741:x1875732037069952:12345-0@lo:501:mount.lustre.0 Request processed in 112us (532us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838002.003585:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788838002.003766:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037069952:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788838002.003825:0:22741:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788838002.003836:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.003844:0:22741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838002.003852:0:22741:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8899c30c6000 10000000:01000000:0.0:1788838002.003858:0:22741:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788838002.003862:0:22741:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8899c30c6000 10000000:01000000:0.0:1788838002.003864:0:22741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788838002.003866:0:22741:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8899c30c6000 from 1 10000000:01000000:0.0:1788838002.003869:0:22741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788838002.003893:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17400/0x57f6d4e926af0950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.003901:0:22741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b17400/0x57f6d4e926af0950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.003910:0:22741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b17400/0x57f6d4e926af0950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838002.003936:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037070080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838002.003965:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838002.003983:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7eae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.004042:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037070080 00000100:00100000:2.0:1788838002.004047:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037070080 00000100:00100000:2.0:1788838002.004101:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788838002.004109:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+6:22741:x1875732037070080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838002.004116:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838002.004139:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6da000/0x57f6d4e926af0957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0950 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.004159:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6da000/0x57f6d4e926af0957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0950 expref: 7 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.004169:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6da000/0x57f6d4e926af0957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0950 expref: 7 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.004178:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da000, rc 0) 00000100:00100000:2.0:1788838002.004212:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+7:22741:x1875732037070080:12345-0@lo:101:mount.lustre.0 Request processed in 104us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.004218:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788838002.004407:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037070080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838002.004419:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b17400/0x57f6d4e926af0950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0957 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.004434:0:22741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17400/0x57f6d4e926af0950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0957 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838002.004446:0:22741:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788838002.004450:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17400/0x57f6d4e926af0950 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0957 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.004456:0:22741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b17400/0x57f6d4e926af0950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0957 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838002.004462:0:22741:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788838002.004466:0:22741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788838002.004470:0:22741:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8899c30c6000 10000000:01000000:0.0:1788838002.004472:0:22741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788838002.004475:0:22741:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788838002.004477:0:22741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788838002.004490:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17600/0x57f6d4e926af095e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.004497:0:22741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b17600/0x57f6d4e926af095e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.004504:0:22741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b17600/0x57f6d4e926af095e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838002.004516:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037070208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838002.004553:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838002.004580:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7eae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.004741:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037070208 00000100:00100000:2.0:1788838002.004746:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037070208 00000100:00100000:2.0:1788838002.004809:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788838002.004817:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+7:22741:x1875732037070208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838002.004824:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838002.004834:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6db200/0x57f6d4e926af0965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af095e expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.004847:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6db200/0x57f6d4e926af0965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af095e expref: 8 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.004854:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6db200/0x57f6d4e926af0965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af095e expref: 8 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.004871:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db200, rc 0) 00000100:00100000:2.0:1788838002.004901:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+8:22741:x1875732037070208:12345-0@lo:101:mount.lustre.0 Request processed in 85us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.004907:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788838002.004984:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037070208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838002.004995:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b17600/0x57f6d4e926af095e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0965 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838002.005009:0:22741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17600/0x57f6d4e926af095e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0965 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838002.005064:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037070336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838002.005102:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838002.005125:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0401a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.005285:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037070336 00000100:00100000:2.0:1788838002.005289:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037070336 00000100:00100000:2.0:1788838002.005307:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788838002.005313:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+8:22741:x1875732037070336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838002.005444:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+9:22741:x1875732037070336:12345-0@lo:501:mount.lustre.0 Request processed in 130us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.005451:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788838002.005512:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037070336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838002.005539:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037070464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838002.005592:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838002.005614:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0401a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.005712:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037070464 00000100:00100000:2.0:1788838002.005716:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037070464 00000100:00100000:2.0:1788838002.005735:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788838002.005742:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+9:22741:x1875732037070464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838002.006524:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+9:22741:x1875732037070464:12345-0@lo:503:mount.lustre.0 Request processed in 778us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.006533:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788838002.007299:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037070464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838002.007807:0:22780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22780:1875732037070592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838002.007861:0:22780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838002.007893:0:22780:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0401480 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.008017:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037070592 00000100:00100000:2.0:1788838002.008023:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037070592 00000100:00100000:2.0:1788838002.008057:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788838002.008064:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+9:22780:x1875732037070592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838002.008806:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+9:22780:x1875732037070592:12345-0@lo:502:llog_process_th.0 Request processed in 711us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.008815:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788838002.009350:0:22780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22780:1875732037070592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788838002.009380:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838002.009391:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838002.009394:0:22780:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788838002.009400:0:22780:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788838002.009403:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838002.009419:0:22780:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8899c22ccd28) 00000020:00000080:1.0:1788838002.009435:0:22780:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788838002.009440:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788838002.011360:0:22780:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788838002.011376:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af0973 00000020:00000080:0.0:1788838002.012022:0:22780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788838002.012033:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838002.012039:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838002.012041:0:22780:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788838002.012045:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838002.012051:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838002.012052:0:22780:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788838002.012057:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838002.012194:0:22780:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff889af99a99b8) 00000020:00000080:0.0:1788838002.012211:0:22780:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788838002.012217:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788838002.012219:0:22780:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788838002.012223:0:22780:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788838002.012230:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788838002.012294:0:22780:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8899c30c6000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788838002.012308:0:22780:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff889af99a8000) 00000020:00000080:0.0:1788838002.012316:0:22780:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788838002.012366:0:22780:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788838002.012371:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af0988 00000020:00000080:0.0:1788838002.012487:0:22780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788838002.012494:0:22780:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788838002.012499:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x57f6d4e926af098f 00080000:01000000:0.0:1788838002.012504:0:22780:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788838002.012508:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af0996 00010000:00010000:3.0:1788838002.111052:0:22780:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788838002.111741:0:22780:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1788838002.112430:0:22780:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788838002.113045:0:22780:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8899c3d30000) 00000020:00000080:3.0:1788838002.113064:0:22780:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788838002.119905:0:22780:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788838002.119934:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af09a4 00000020:00000080:3.0:1788838002.121169:0:22780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788838002.129295:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x57f6d4e926af09ab 00000020:00000080:3.0:1788838002.129669:0:22780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788838002.129682:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838002.129688:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838002.129691:0:22780:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788838002.129695:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788838002.129698:0:22780:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788838002.129700:0:22780:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788838002.129701:0:22780:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788838002.129703:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788838002.129705:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838002.129707:0:22780:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788838002.129710:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838002.129715:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838002.129716:0:22780:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788838002.129721:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788838002.129755:0:22780:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788838002.129769:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838002.129772:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838002.129799:0:22780:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788838002.129803:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838002.129807:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838002.129808:0:22780:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788838002.129811:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788838002.129816:0:22780:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:00000080:3.0:1788838002.129847:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788838002.129861:0:22780:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8899c3d34d28) 00000020:00000080:3.0:1788838002.129875:0:22780:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788838002.129886:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788838002.130267:0:22780:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788838002.130273:0:22780:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788838002.130280:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af09b9 00010000:00080000:3.0:1788838002.130332:0:22780:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c2479000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788838002.136356:0:22780:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788838002.138745:0:22780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788838002.138761:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788838002.138831:0:22780:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788838002.138850:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af09c0 00000100:00080000:2.0:1788838002.138860:0:22780:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788838002.138866:0:22780:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8899c2479000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788838002.138902:0:22780:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4f800 x1875732037070720/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838002.138936:0:22780:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788838002.138996:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838002.139001:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838002.139003:0:22780:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788838002.139006:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788838002.139009:0:22780:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788838002.139011:0:22780:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788838002.139012:0:22780:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788838002.139014:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788838002.139017:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838002.139018:0:22780:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788838002.139021:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788838002.139025:0:22780:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788838002.139028:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838002.139030:0:22780:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788838002.139033:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788838002.139036:0:22780:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:2.0:1788838002.139060:0:22780:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788838002.139063:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:1.0:1788838002.139277:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838002.139290:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037070848:0@lo:400:kworker.0 00000100:00100000:1.0:1788838002.139365:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838002.139503:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037070720:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838002.139537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838002.139671:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037070848 00000100:00100000:0.0:1788838002.139677:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037070848 00000100:00100000:0.0:1788838002.139722:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788838002.139731:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889acadd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+9:3651:x1875732037070848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838002.139816:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889acadd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+9:3651:x1875732037070848:12345-0@lo:400:kworker.0 Request processed in 86us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838002.139824:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788838002.139869:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037070848:0@lo:400:kworker.0 00000100:00100000:1.0:1788838002.140024:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037070720 00000100:00100000:1.0:1788838002.140028:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037070720 00000100:00100000:1.0:1788838002.140050:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788838002.140055:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875732037070720:12345-0@lo:38:llog_process_th.0 00000020:00000080:2.0:1788838002.140228:0:22780:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff889ac8578000) 00010000:00020000:1.0:1788838002.140307:0:22767:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:2.0:1788838002.143618:0:22780:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788838002.143651:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788838002.143742:0:22780:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788838002.143749:0:22780:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788838002.143760:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af09ce 00010000:00080000:2.0:1788838002.143872:0:22780:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889aded39800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788838002.144654:0:22780:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788838002.145971:0:22780:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788838002.146283:0:22780:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788838002.149223:0:22780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788838002.149615:0:22780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:1.0:1788838002.154062:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875732037070720:12345-0@lo:38:llog_process_th.0 Request processed in 13998us (14516us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838002.154089:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788838002.154442:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c2479000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838002.154449:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838002.154452:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037070720:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788838002.154751:0:22780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788838002.155143:0:22786:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788838002.155147:0:22786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788838002.155698:0:22780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788838002.155710:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788838002.156454:0:22780:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788838002.156487:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af09d5 00000100:00080000:2.0:1788838002.156495:0:22780:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788838002.156499:0:22780:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff889aded39800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788838002.156528:0:22780:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4ed80 x1875732037070976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838002.156556:0:22780:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788838002.156619:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838002.156624:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838002.156626:0:22780:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788838002.156629:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788838002.156632:0:22780:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788838002.156634:0:22780:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788838002.156635:0:22780:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788838002.156637:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788838002.156639:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838002.156647:0:22780:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788838002.156650:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788838002.156655:0:22780:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788838002.156659:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838002.156660:0:22780:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788838002.156663:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788838002.156666:0:22780:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000100:00100000:0.0:1788838002.156685:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037070976:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1788838002.156690:0:22780:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788838002.156692:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788838002.156705:0:22780:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff889ac857b370) 00000020:00000080:2.0:1788838002.156717:0:22780:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788838002.156721:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000400:00000100:0.0:1788838002.156733:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037070976 offset 0 length 520: 4 00000004:00080000:2.0:1788838002.156801:0:22780:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788838002.156807:0:22780:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788838002.156812:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af09e3 00010000:00080000:2.0:1788838002.156840:0:22780:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889ac4e49000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788838002.157039:0:22780:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788838002.157097:0:22780:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788838002.157111:0:22780:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788838002.158402:0:22780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788838002.158546:0:22780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788838002.158641:0:22780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788838002.159113:0:22788:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788838002.159117:0:22788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788838002.159506:0:22780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788838002.159515:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788838002.159541:0:22780:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788838002.159560:0:22780:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af09ea 00000100:00080000:2.0:1788838002.159569:0:22780:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788838002.159574:0:22780:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff889ac4e49000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788838002.159605:0:22780:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4dc00 x1875732037071104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838002.159624:0:22780:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788838002.159659:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037071104:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1788838002.159685:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838002.159688:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838002.159690:0:22780:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788838002.159693:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838002.159696:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838002.159698:0:22780:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788838002.159700:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788838002.159701:0:22780:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788838002.159703:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838002.159705:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838002.159707:0:22780:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000400:00000100:0.0:1788838002.159707:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037071104 offset 0 length 520: 4 00000020:01000000:2.0:1788838002.159709:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838002.159711:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838002.159712:0:22780:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788838002.159715:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788838002.159741:0:22780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22780:1875732037071232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838002.159809:0:22780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838002.159832:0:22780:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa73a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788838002.159880:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037071232 00000100:00100000:0.0:1788838002.159886:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037071232 00000100:00100000:0.0:1788838002.159937:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788838002.159946:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889acaddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+9:22780:x1875732037071232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838002.160050:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889acaddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+9:22780:x1875732037071232:12345-0@lo:502:llog_process_th.0 Request processed in 104us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838002.160057:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788838002.160064:0:22780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22780:1875732037071232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838002.160089:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838002.160093:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838002.160095:0:22780:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788838002.160098:0:22780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788838002.160197:0:22741:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788838002.160217:0:22741:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788838002.160229:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17600/0x57f6d4e926af095e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0965 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838002.160240:0:22741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b17600/0x57f6d4e926af095e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0965 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838002.160248:0:22741:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8899c30c6000 from 1 10000000:01000000:1.0:1788838002.160250:0:22741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788838002.160275:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838002.160283:0:22741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838002.160292:0:22741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838002.160303:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037071360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788838002.160335:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838002.160356:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad2b7f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788838002.160408:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037071360 00000100:00100000:3.0:1788838002.160413:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037071360 00000100:00100000:3.0:1788838002.160435:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788838002.160442:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889acadda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+9:22741:x1875732037071360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838002.160451:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838002.160465:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c2229400/0x57f6d4e926af09f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af09f1 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.160485:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2229400/0x57f6d4e926af09f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af09f1 expref: 10 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.160495:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c2229400/0x57f6d4e926af09f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af09f1 expref: 10 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.160503:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2229400, rc 0) 00000100:00100000:3.0:1788838002.160548:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889acadda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+10:22741:x1875732037071360:12345-0@lo:101:mount.lustre.0 Request processed in 99us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838002.160554:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788838002.160608:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037071360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838002.160617:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838002.160623:0:22741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838002.161233:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037071488:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788838002.161264:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838002.161287:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad2b7f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788838002.161295:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037071488 00000100:00100000:0.0:1788838002.161300:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037071488 00000100:00100000:0.0:1788838002.161333:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788838002.161341:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac33df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+10:22741:x1875732037071488:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788838002.161355:0:22756:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788838002.161360:0:22756:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788838002.161478:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac33df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+10:22741:x1875732037071488:12345-0@lo:256:mount.lustre.0 Request processed in 137us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838002.161485:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788838002.161487:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037071488:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788838002.162040:0:22741:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788838002.162054:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838002.162063:0:22741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838002.162102:0:22741:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8899c30c6000 from 1 10000000:01000000:0.0:1788838002.162106:0:22741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788838002.162140:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.162148:0:22741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.162156:0:22741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838002.162170:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037071616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838002.162192:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838002.162215:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7eaeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838002.162236:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037071616 00000100:00100000:3.0:1788838002.162241:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037071616 00000100:00100000:3.0:1788838002.162310:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788838002.162317:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac33dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+10:22741:x1875732037071616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838002.162330:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838002.162339:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c2228a00/0x57f6d4e926af0a06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af09ff expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.162352:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2228a00/0x57f6d4e926af0a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af09ff expref: 11 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.162358:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c2228a00/0x57f6d4e926af0a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af09ff expref: 11 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.162364:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2228a00, rc 0) 00000100:00100000:3.0:1788838002.162394:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac33dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:22741:x1875732037071616:12345-0@lo:101:mount.lustre.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838002.162400:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788838002.162618:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037071616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838002.162631:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.162640:0:22741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838002.162701:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037071744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838002.162720:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838002.162738:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7eaeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838002.162759:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037071744 00000100:00100000:3.0:1788838002.162763:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037071744 00000100:00100000:3.0:1788838002.162915:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788838002.162934:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac33dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:22741:x1875732037071744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838002.163074:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac33dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:22741:x1875732037071744:12345-0@lo:501:mount.lustre.0 Request processed in 143us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838002.163081:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788838002.163224:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037071744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838002.163252:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037071872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838002.163279:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838002.163302:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7eaeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838002.163316:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037071872 00000100:00100000:3.0:1788838002.163320:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037071872 00000100:00100000:3.0:1788838002.163347:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788838002.163354:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:22741:x1875732037071872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838002.163424:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:22741:x1875732037071872:12345-0@lo:503:mount.lustre.0 Request processed in 69us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838002.163438:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788838002.163448:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037071872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838002.164075:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22790:1875732037072000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838002.164116:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838002.164255:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7eae0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838002.164291:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037072000 00000100:00100000:3.0:1788838002.164300:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037072000 00000100:00100000:3.0:1788838002.164334:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788838002.164341:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:22790:x1875732037072000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838002.164767:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:22790:x1875732037072000:12345-0@lo:502:llog_process_th.0 Request processed in 426us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838002.164803:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788838002.164910:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22790:1875732037072000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788838002.165018:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838002.165030:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838002.165032:0:22790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788838002.165040:0:22790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8899c30c6000 00000020:00000080:0.0:1788838002.165042:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838002.165051:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838002.165053:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838002.165055:0:22790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788838002.165057:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838002.165059:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838002.165061:0:22790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788838002.165064:0:22790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8899c30c6000 00000020:00000080:0.0:1788838002.165066:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838002.165124:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838002.165128:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838002.165130:0:22790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788838002.165132:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838002.165135:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838002.165136:0:22790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788838002.165139:0:22790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8899c30c6000 00000020:00000080:0.0:1788838002.165141:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838002.165167:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838002.165170:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838002.165172:0:22790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788838002.165174:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838002.165177:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838002.165178:0:22790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788838002.165181:0:22790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8899c30c6000 00000020:00000080:0.0:1788838002.165184:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788838002.165221:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22790:1875732037072128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838002.165256:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838002.165287:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac55ab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.165940:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037072128 00000100:00100000:2.0:1788838002.165946:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037072128 00000100:00100000:2.0:1788838002.165989:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788838002.165997:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:22790:x1875732037072128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838002.167320:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:22790:x1875732037072128:12345-0@lo:502:llog_process_th.0 Request processed in 1318us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.167331:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788838002.168076:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22790:1875732037072128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788838002.168113:0:22790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838002.168121:0:22790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838002.168123:0:22790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788838002.168127:0:22790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788838002.168631:0:22741:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788838002.168653:0:22741:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788838002.168669:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.168680:0:22741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838002.168730:0:22741:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788838002.168733:0:22741:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8899c30c6000 10000000:01000000:2.0:1788838002.168736:0:22741:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8899c30c6000 10000000:01000000:2.0:1788838002.168740:0:22741:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788838002.168745:0:22741:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8899c30c6000 from 1 10000000:01000000:2.0:1788838002.168748:0:22741:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788838002.168798:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da600/0x57f6d4e926af0a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.168806:0:22741:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6da600/0x57f6d4e926af0a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.168815:0:22741:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6da600/0x57f6d4e926af0a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838002.168835:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037072256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838002.168885:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838002.168916:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa73ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838002.169104:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037072256 00000100:00100000:3.0:1788838002.169110:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037072256 00000100:00100000:3.0:1788838002.169157:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788838002.169167:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:22741:x1875732037072256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838002.169181:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838002.169194:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c2228000/0x57f6d4e926af0a14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0a0d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.169216:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2228000/0x57f6d4e926af0a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0a0d expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.169226:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c2228000/0x57f6d4e926af0a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0a0d expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.169248:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2228000, rc 0) 00000100:00100000:3.0:1788838002.169294:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22741:x1875732037072256:12345-0@lo:101:mount.lustre.0 Request processed in 128us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838002.169300:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788838002.169395:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037072256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838002.169408:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6da600/0x57f6d4e926af0a0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a14 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.169427:0:22741:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6da600/0x57f6d4e926af0a0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0a14 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838002.169477:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037072384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838002.169502:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838002.169528:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa73ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838002.169639:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037072384 00000100:00100000:3.0:1788838002.169644:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037072384 00000100:00100000:3.0:1788838002.169675:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788838002.169682:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22741:x1875732037072384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838002.169816:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22741:x1875732037072384:12345-0@lo:501:mount.lustre.0 Request processed in 133us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838002.169823:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788838002.169913:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037072384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838002.169955:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037072512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838002.169994:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838002.170023:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa73ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.170037:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037072512 00000100:00100000:2.0:1788838002.170040:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037072512 00000100:00100000:2.0:1788838002.170075:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788838002.170082:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22741:x1875732037072512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838002.170286:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22741:x1875732037072512:12345-0@lo:503:mount.lustre.0 Request processed in 204us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.170293:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788838002.170334:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037072512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838002.170511:0:22792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22792:1875732037072640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838002.170552:0:22792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838002.170572:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037072640 00000100:00100000:2.0:1788838002.170576:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037072640 00000100:00100000:2.0:1788838002.170598:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788838002.170603:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22792:x1875732037072640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838002.170681:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22792:x1875732037072640:12345-0@lo:502:llog_process_th.0 Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.170688:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788838002.170715:0:22792:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa73af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.170726:0:22792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22792:1875732037072640:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788838002.170803:0:22792:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788838002.170819:0:22792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff889ac85799b8) 00000020:00000080:2.0:1788838002.170836:0:22792:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788838002.170931:0:22792:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8899c30c6000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788838002.170936:0:22792:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8899c30c6000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788838002.170938:0:22792:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8899c30c6000 4 00010000:00080000:2.0:1788838002.170970:0:22792:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889acaed7800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788838002.185020:0:22792:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788838002.185863:0:22792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788838002.185928:0:22792:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788838002.185945:0:22792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x57f6d4e926af0a22 00000100:00080000:2.0:1788838002.185957:0:22792:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788838002.185963:0:22792:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff889acaed7800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788838002.185998:0:22792:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4df80 x1875732037072768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838002.186021:0:22792:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788838002.188762:0:22792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22792:1875732037072896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838002.188863:0:22792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838002.188906:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037072896 00000100:00100000:2.0:1788838002.188913:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037072896 00000100:00100000:2.0:1788838002.188966:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838002.188974:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22792:x1875732037072896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838002.189087:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22792:x1875732037072896:12345-0@lo:502:llog_process_th.0 Request processed in 113us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.189095:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838002.189157:0:22792:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa73a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.189178:0:22792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22792:1875732037072896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838002.189216:0:22792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22792:1875732037073024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838002.189248:0:22792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838002.189270:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037073024 00000100:00100000:2.0:1788838002.189274:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037073024 00000100:00100000:2.0:1788838002.189297:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788838002.189304:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22792:x1875732037073024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838002.189364:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22792:x1875732037073024:12345-0@lo:502:llog_process_th.0 Request processed in 59us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.189370:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788838002.189398:0:22792:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa73a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.189409:0:22792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22792:1875732037073024:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788838002.189426:0:22792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788838002.189476:0:22741:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788838002.189497:0:22741:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788838002.189520:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da600/0x57f6d4e926af0a0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a14 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.189531:0:22741:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6da600/0x57f6d4e926af0a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a14 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788838002.189575:0:22741:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788838002.189582:0:22741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838002.189583:0:22741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838002.189584:0:22741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838002.189585:0:22741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838002.189587:0:22741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838002.189588:0:22741:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838002.189589:0:22741:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788838002.189590:0:22741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838002.189591:0:22741:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838002.189595:0:22741:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788838002.189597:0:22741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788838002.189598:0:22741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838002.189599:0:22741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838002.189600:0:22741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838002.189601:0:22741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838002.189602:0:22741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838002.189603:0:22741:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838002.189604:0:22741:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788838002.189605:0:22741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838002.189606:0:22741:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838002.189618:0:22741:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788838002.189626:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037073152:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788838002.189654:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838002.189667:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa73a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.189682:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037073152 00000100:00100000:2.0:1788838002.189686:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037073152 00000100:00100000:2.0:1788838002.189707:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788838002.189713:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22741:x1875732037073152:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788838002.189732:0:22755:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788838002.189745:0:22755:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788838002.191936:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037072768:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788838002.192012:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838002.192701:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037072768 00000100:00100000:3.0:1788838002.192710:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037072768 00000100:00100000:3.0:1788838002.192744:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788838002.192752:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875732037072768:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838002.192842:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875732037072768:12345-0@lo:38:llog_process_th.0 Request processed in 89us (829us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788838002.192850:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 20000000:01000000:3.0:1788838002.194648:0:22755:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788838002.194666:0:22755:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788838002.194864:0:22778:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788838002.194871:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788838002.195193:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.195214:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c2229400/0x57f6d4e926af09f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af09f1 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.195231:0:22778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.195272:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c2229400/0x57f6d4e926af09f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af09f1 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.195288:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c2229400/0x57f6d4e926af09f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af09f1 expref: 12 pid: 22757 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838002.195303:0:22778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037073280:0@lo:104: 00000100:00100000:2.0:1788838002.195364:0:22778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838002.195407:0:22778:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa73acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838002.195449:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037073280 00000100:00100000:2.0:1788838002.195457:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037073280 00000100:00100000:2.0:1788838002.195497:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838002.195506:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:22778:x1875732037073280:12345-0@lo:104: 00010000:00010000:2.0:1788838002.195518:0:22745:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838002.196161:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788838002.196171:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889acaed7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838002.196176:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788838002.196180:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037072768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838002.196296:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22741:x1875732037073152:12345-0@lo:253:mount.lustre.0 Request processed in 6581us (6640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838002.196867:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22741:1875732037073152:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788838002.196881:0:22741:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788838002.196884:0:22741:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788838002.196886:0:22741:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788838002.196888:0:22741:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838002.196889:0:22741:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838002.196891:0:22741:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838002.196892:0:22741:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838002.196893:0:22741:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788838002.196895:0:22741:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788838002.196897:0:22741:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838002.196898:0:22741:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788838002.196911:0:22741:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788838002.196954:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788838002.197697:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788838002.197707:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:22778:x1875732037073280:12345-0@lo:104: Request processed in 2201us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.197716:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838002.197768:0:22778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037073280:0@lo:104: 00010000:00010000:2.0:1788838002.197826:0:22778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.198362:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838002.198371:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.198380:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9ae00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788838002.198385:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.198394:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838002.198402:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838002.198408:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838002.198447:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.198454:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838002.198474:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.198490:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af09f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af09f8 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838002.198508:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838002.198510:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838002.198512:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838002.198532:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037073408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838002.199186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838002.199667:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037073408 00000100:00100000:3.0:1788838002.199675:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037073408 00010000:00010000:3.0:1788838002.199705:0:22747:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c2229400/0x57f6d4e926af09f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af09f1 expref: 12 pid: 22757 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838002.199748:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788838002.199758:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:3651:x1875732037073408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838002.199772:0:22747:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838002.199793:0:22747:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c2229400/0x57f6d4e926af09f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af09f1 expref: 12 pid: 22757 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.199803:0:22747:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c2229400/0x57f6d4e926af09f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af09f1 expref: 12 pid: 22757 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.199818:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c2229400/0x57f6d4e926af09f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af09f1 expref: 12 pid: 22757 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.199833:0:22747:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.199841:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788838002.199857:0:22747:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004987079s 00010000:00010000:3.0:1788838002.199861:0:22747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.199868:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.199875:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.199882:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.199894:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838002.199898:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.199906:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.199937:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838002.199948:0:22747:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838002.199996:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:3651:x1875732037073408:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838002.200004:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788838002.200152:0:22778:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.200166:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838002.200173:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6da800/0x57f6d4e926af0a29 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838002.201896:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037073408:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788838002.217606:0:22741:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1788838002.218022:0:22741:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788838002.218086:0:22802:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:1.0:1788838002.218090:0:22802:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:1.0:1788838002.219014:0:22803:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788838002.219285:0:22741:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788838002.219526:0:22803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838002.226517:0:22803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788838002.226585:0:22803:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:0.0:1788838002.230303:0:22804:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8899c4baad80 x1875732037073536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838002.230318:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00000040:01000000:0.0:1788838002.231016:0:22741:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788838002.231054:0:22741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788838002.232195:0:22741:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788838002.232205:0:22741:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788838002.232260:0:22741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838002.235217:0:22741:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788838002.235963:0:22741:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788838002.236042:0:22741:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788838002.238221:0:22741:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788838002.238735:0:22741:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1788838002.240424:0:22741:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788838002.242300:0:22741:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788838002.242330:0:22741:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3bc81c67988 00100000:10000000:1.0:1788838002.242336:0:22741:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788838002.244144:0:22741:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788838002.244161:0:22741:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788838002.244181:0:22741:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788838002.244206:0:22741:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788838002.257914:0:22741:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838002.259109:0:22741:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788838002.810495:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788838003.258404:0:22797:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788838003.258416:0:22797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788838003.259249:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00000040:00080000:3.0:1788838003.261103:0:22797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788838003.261129:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788838003.834661:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788838003.844194:0:22759:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788838003.844203:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8899c30c6000 from 11 10000000:01000000:3.0:1788838003.844208:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788838003.844253:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838003.844265:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838003.844276:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838003.844310:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037073664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838003.844386:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838003.844442:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac55abe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838003.844586:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037073664 00000100:00100000:1.0:1788838003.844610:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037073664 00000100:00100000:1.0:1788838003.844668:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788838003.844676:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+11:22759:x1875732037073664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838003.844690:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838003.844709:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af0a37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0a30 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838003.844733:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af0a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0a30 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838003.844743:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af0a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0a30 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838003.844752:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b200, rc 0) 00000100:00100000:1.0:1788838003.844809:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22759:x1875732037073664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838003.844817:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788838003.845002:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037073664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838003.845018:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838003.845027:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838003.845079:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037073792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788838003.845124:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838003.845153:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac55abe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838003.845229:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037073792 00000100:00100000:1.0:1788838003.845233:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037073792 00000100:00100000:1.0:1788838003.845267:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788838003.845273:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22759:x1875732037073792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788838003.845288:0:22755:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788838003.845305:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788838003.845308:0:22755:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788838003.845394:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:22759:x1875732037073792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838003.845414:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788838003.847034:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037073792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788838003.847108:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788838003.847118:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838003.847127:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788838004.281128:0:22797:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788838004.281138:0:22797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788838004.281283:0:22797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788838004.281323:0:22797:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788838004.281486:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788838004.281880:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788838004.860244:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838005.304954:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788838005.881172:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838006.328930:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788838006.905312:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788838006.983673:0:23046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788838007.233699:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037073920:0@lo:400:kworker.0 00000100:00100000:1.0:1788838007.233803:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838007.233905:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037073920 00000100:00100000:0.0:1788838007.233913:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037073920 00000100:00100000:0.0:1788838007.233961:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788838007.233969:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:3648:x1875732037073920:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788838007.234418:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788838007.234423:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788838007.234426:0:38:0:(import.c:65:import_set_state_nolock()) ffff8899c2479000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838007.234438:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 619 00000100:00080000:3.0:1788838007.234442:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838007.234447:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8899c2479000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788838007.234470:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4baf800 x1875732037074048/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838007.234485:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838007.234489:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838007.234491:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838007.234493:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838007.234495:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788838007.234498:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838007.234499:0:38:0:(import.c:65:import_set_state_nolock()) ffff889acaed7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838007.234503:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff889acaed7800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788838007.234512:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4baca80 x1875732037074176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838007.234568:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037074048:0@lo:38:kworker.0 00000100:00100000:3.0:1788838007.234606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838007.234628:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037074176:0@lo:38:kworker.0 00000100:00100000:3.0:1788838007.234654:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838007.234688:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037074176 00000100:00100000:3.0:1788838007.234692:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037074176 00000100:00100000:3.0:1788838007.234713:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838007.234719:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875732037074176:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788838007.235865:0:22764:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 624 last 0 00000020:00000080:3.0:1788838007.235911:0:22764:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x57f6d4e926af0a3e 00000004:00100000:3.0:1788838007.235928:0:22764:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788838007.236066:0:22764:0:(import.c:65:import_set_state_nolock()) ffff889ac85f5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838007.236131:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875732037074176:12345-0@lo:38:kworker.0 Request processed in 1410us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838007.236140:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788838007.236212:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8899c4baca80 x1875732037074176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838007.236228:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788838007.236235:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788838007.236239:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788838007.236242:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889acaed7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788838007.236248:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037074176:0@lo:38:kworker.0 00000100:00100000:0.0:1788838007.249459:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:3648:x1875732037073920:12345-0@lo:400:kworker.0 Request processed in 15481us (15647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838007.249475:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788838007.249611:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037074048 00000100:00100000:0.0:1788838007.249620:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037074048 00000100:00100000:0.0:1788838007.249661:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788838007.249667:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037074048:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838007.249684:0:22768:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838007.249759:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037074048:12345-0@lo:38:kworker.0 Request processed in 91us (15153us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838007.249765:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788838007.249871:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037073920:0@lo:400:kworker.0 00000100:00080000:0.0:1788838007.268804:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c2479000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838007.268818:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838007.268824:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037074048:0@lo:38:kworker.0 00000100:00100000:2.0:1788838007.353253:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788838007.935817:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788838008.037247:0:23098:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788838008.037888:0:23098:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788838008.376871:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00000020:00000004:3.0:1788838008.829554:0:23149:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788838008.829747:0:23149:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788838008.954944:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838009.401258:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788838009.977092:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838010.425150:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788838011.001893:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838011.448843:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788838012.028395:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788838012.346397:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788838012.346403:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788838012.346407:0:37:0:(import.c:65:import_set_state_nolock()) ffff8899c2479000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838012.346415:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 624 00000100:00080000:2.0:1788838012.346421:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788838012.346427:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8899c2479000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788838012.346449:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4c380 x1875732037074432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838012.346471:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838012.346474:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788838012.346477:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838012.346479:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788838012.346514:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037074304:0@lo:400:kworker.0 00000100:00100000:2.0:1788838012.346577:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838012.346644:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838002/real 1788838002] req@ffff889affc4dc00 x1875732037071104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838012 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838012.346662:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889affc4dc00 x1875732037071104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838012 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838012.346673:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838002/real 1788838002] req@ffff889affc4ed80 x1875732037070976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838012 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838012.346684:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889affc4ed80 x1875732037070976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838012 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838012.346696:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037074432:0@lo:38:kworker.0 00000100:00100000:2.0:1788838012.346727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788838012.346761:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ac4e49000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838012.346772:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788838012.346792:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037071104:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788838012.346798:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889aded39800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838012.346803:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788838012.346812:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037070976:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788838012.346838:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037074560:0@lo:400:kworker.0 00000100:00100000:2.0:1788838012.346867:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838012.346902:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037074304 00000100:00100000:2.0:1788838012.346909:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037074304 00000100:00100000:2.0:1788838012.346951:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788838012.346959:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:3649:x1875732037074304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838012.347003:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:3649:x1875732037074304:12345-0@lo:400:kworker.0 Request processed in 45us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838012.347010:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788838012.347066:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037074432 00000100:00100000:2.0:1788838012.347071:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037074432 00000100:00100000:2.0:1788838012.347092:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788838012.347097:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037074432:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838012.347112:0:22768:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838012.347144:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037074432:12345-0@lo:38:kworker.0 Request processed in 46us (417us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838012.347150:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788838012.347164:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838012.347167:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788838012.347169:0:37:0:(import.c:65:import_set_state_nolock()) ffff889aded39800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838012.347172:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 619 00000100:00080000:2.0:1788838012.347175:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788838012.347178:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff889aded39800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788838012.347192:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4dc00 x1875732037074688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838012.347207:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838012.347210:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788838012.347211:0:37:0:(import.c:65:import_set_state_nolock()) ffff889ac4e49000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838012.347214:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 619 00000100:00080000:2.0:1788838012.347217:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788838012.347220:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff889ac4e49000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788838012.347232:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4df80 x1875732037074816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838012.347262:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037074560 00000100:00100000:2.0:1788838012.347265:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037074560 00000100:00100000:2.0:1788838012.347415:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838012.347421:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037074560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838012.347457:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037074560:12345-0@lo:400:kworker.0 Request processed in 36us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838012.347463:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838012.347494:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037074304:0@lo:400:kworker.0 00000100:00100000:2.0:1788838012.347518:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037074688:0@lo:8:kworker.0 00000400:00000100:2.0:1788838012.347550:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037074688 offset 0 length 520: 4 00000100:00100000:2.0:1788838012.347569:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037074816:0@lo:8:kworker.0 00000400:00000100:2.0:1788838012.347587:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037074816 offset 0 length 520: 4 00000100:00080000:2.0:1788838012.347603:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c2479000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838012.347606:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838012.347609:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037074432:0@lo:38:kworker.0 00010000:00080000:2.0:1788838012.347644:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff889affc4f480 x1875732037074560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838012.347655:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037074560:0@lo:400:kworker.0 00000100:00100000:2.0:1788838012.472915:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788838013.048882:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838013.502145:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788838014.074195:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838014.521729:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00000040:00080000:0.0:1788838014.527178:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788838015.097490:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838015.550045:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00000020:01000004:0.0:1788838015.643324:0:23493:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788838015.643328:0:23493:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788838015.643330:0:23493:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788838015.643436:0:23493:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8899c277b800 00000020:01000004:0.0:1788838015.643453:0:23493:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788838015.643467:0:23493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788838015.643481:0:23493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff889af99acd28) 00000020:00000080:0.0:1788838015.643498:0:23493:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788838015.813797:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788838015.814876:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788838015.818220:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788838015.820132:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788838015.822236:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788838015.823458:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788838015.825995:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788838015.826735:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788838015.834974:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788838015.835219:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788838015.835427:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788838015.835618:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788838015.835944:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788838015.836343:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788838015.837456:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.838377:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.842162:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.843104:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.843399:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.843658:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.843997:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.844187:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.844390:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.844604:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.844821:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.845036:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.845392:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.845603:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.846321:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.846654:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.847182:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.849108:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.850001:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.850337:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.850989:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.851319:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.851565:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.852250:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.852519:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.852962:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.853848:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.854720:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.855224:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.855479:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788838015.855799:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788838015.856059:0:23493:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00080000:01000000:0.0:1788838015.866331:0:23493:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788838015.866702:0:23493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788838015.866716:0:23493:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788838015.866728:0:23493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af0a4c 00000020:01000004:0.0:1788838015.866735:0:23493:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788838015.866761:0:23493:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788838015.866765:0:23493:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788838015.866772:0:23493:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788838015.866825:0:23493:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788838015.866830:0:23493:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788838015.883976:0:23493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788838015.884031:0:23493:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.103@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788838015.884036:0:23493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788838015.884037:0:23493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788838015.884039:0:23493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838015.884040:0:23493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838015.884041:0:23493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838015.884042:0:23493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838015.884043:0:23493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838015.884044:0:23493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838015.884045:0:23493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788838015.886869:0:23493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788838015.886880:0:23493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788838015.886882:0:23493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788838015.886883:0:23493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838015.886885:0:23493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838015.886886:0:23493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838015.886954:0:23493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838015.886955:0:23493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838015.886957:0:23493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838015.886974:0:23493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788838015.887008:0:23493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788838015.887030:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037074944:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788838015.887324:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838015.887377:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f7fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838015.887432:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037074944 00000100:00100000:1.0:1788838015.887439:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037074944 00000100:00100000:1.0:1788838015.887536:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788838015.887545:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:23493:x1875732037074944:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788838015.887587:0:22755:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788838015.887597:0:22755:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788838015.887653:0:22755:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788838015.888157:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:23493:x1875732037074944:12345-0@lo:253:mount.lustre.0 Request processed in 611us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838015.888165:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788838015.888271:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037074944:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788838015.888281:0:23493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788838015.888283:0:23493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788838015.888285:0:23493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788838015.888286:0:23493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838015.888287:0:23493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838015.888288:0:23493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838015.888289:0:23493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838015.888290:0:23493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838015.888292:0:23493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838015.888293:0:23493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788838015.888313:0:23493:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8899c277b800 from lustre-MDT0001 10000000:01000000:0.0:1788838015.888344:0:23493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788838015.888346:0:23493:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788838015.888353:0:23493:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889af99ab370 local copy 00010000:00010000:0.0:1788838015.888362:0:23493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838015.888448:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838015.888476:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838015.888792:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f7f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838015.888871:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037075072 00000100:00100000:2.0:1788838015.888877:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037075072 00000100:00100000:2.0:1788838015.888941:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788838015.888950:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:23493:x1875732037075072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838015.889029:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:23493:x1875732037075072:12345-0@lo:501:mount.lustre.0 Request processed in 80us (551us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788838015.889036:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788838015.889122:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075072:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788838015.889135:0:23493:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788838015.889153:0:23493:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788838015.889160:0:23493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838015.889180:0:23493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838015.889205:0:23493:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8899c277b800 10000000:01000000:0.0:1788838015.889209:0:23493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788838015.889214:0:23493:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff889af99ab370 10000000:01000000:0.0:1788838015.889228:0:23493:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788838015.889232:0:23493:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff889af99ab370 from 1 10000000:01000000:0.0:1788838015.889234:0:23493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788838015.889258:0:23493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926af0a53 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838015.889266:0:23493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926af0a53 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838015.889275:0:23493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926af0a53 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838015.889289:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838015.889315:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838015.889338:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f7f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838015.889544:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037075200 00000100:00100000:2.0:1788838015.889549:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037075200 00000100:00100000:2.0:1788838015.889570:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788838015.889575:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+12:23493:x1875732037075200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838015.889647:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838015.889661:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6dbe00/0x57f6d4e926af0a5a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0a53 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838015.889680:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6dbe00/0x57f6d4e926af0a5a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0a53 expref: 13 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838015.889700:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6dbe00/0x57f6d4e926af0a5a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0a53 expref: 13 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838015.889719:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dbe00, rc 0) 00000100:00100000:2.0:1788838015.889761:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+13:23493:x1875732037075200:12345-0@lo:101:mount.lustre.0 Request processed in 185us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838015.889767:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788838015.890037:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838015.890064:0:23493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926af0a53 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a5a expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838015.890073:0:23493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926af0a53 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0a5a expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838015.890101:0:23493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788838015.890117:0:23493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926af0a53 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a5a expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838015.890125:0:23493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926af0a53 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a5a expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838015.890132:0:23493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8899c277b800 10000000:01000000:0.0:1788838015.890135:0:23493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788838015.890139:0:23493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8899c277b800 from 1 10000000:01000000:0.0:1788838015.890141:0:23493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788838015.890158:0:23493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16400/0x57f6d4e926af0a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838015.890165:0:23493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b16400/0x57f6d4e926af0a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838015.890173:0:23493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b16400/0x57f6d4e926af0a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838015.890186:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838015.890213:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838015.890393:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f7f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838015.890459:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037075328 00000100:00100000:2.0:1788838015.890464:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037075328 00000100:00100000:2.0:1788838015.890487:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788838015.890494:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+13:23493:x1875732037075328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838015.890501:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838015.890510:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6dae00/0x57f6d4e926af0a68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0a61 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838015.890525:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6dae00/0x57f6d4e926af0a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0a61 expref: 14 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838015.890533:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6dae00/0x57f6d4e926af0a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0a61 expref: 14 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838015.890540:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dae00, rc 0) 00000100:00100000:2.0:1788838015.890591:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+14:23493:x1875732037075328:12345-0@lo:101:mount.lustre.0 Request processed in 98us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838015.890597:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788838015.890710:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838015.890721:0:23493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b16400/0x57f6d4e926af0a61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a68 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838015.890729:0:23493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16400/0x57f6d4e926af0a61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0a68 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838015.890747:0:23493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788838015.890763:0:23493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16400/0x57f6d4e926af0a61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a68 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838015.890770:0:23493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b16400/0x57f6d4e926af0a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a68 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838015.890794:0:23493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788838015.890798:0:23493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788838015.890803:0:23493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8899c277b800 10000000:01000000:0.0:1788838015.890805:0:23493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788838015.890808:0:23493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788838015.890811:0:23493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788838015.890824:0:23493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17000/0x57f6d4e926af0a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838015.890830:0:23493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b17000/0x57f6d4e926af0a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838015.890838:0:23493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b17000/0x57f6d4e926af0a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838015.890852:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838015.890876:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838015.890907:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f7f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838015.891037:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037075456 00000100:00100000:1.0:1788838015.891042:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037075456 00000100:00100000:2.0:1788838015.891312:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788838015.891320:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+14:23493:x1875732037075456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838015.891328:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838015.891338:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6da200/0x57f6d4e926af0a76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0a6f expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838015.891360:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6da200/0x57f6d4e926af0a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0a6f expref: 15 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838015.891368:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6da200/0x57f6d4e926af0a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0a6f expref: 15 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838015.891375:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da200, rc 0) 00000100:00100000:2.0:1788838015.891414:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+15:23493:x1875732037075456:12345-0@lo:101:mount.lustre.0 Request processed in 95us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838015.891420:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788838015.891498:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838015.891509:0:23493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b17000/0x57f6d4e926af0a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a76 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838015.891516:0:23493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17000/0x57f6d4e926af0a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0a76 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788838015.892869:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1788838015.893646:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838015.898969:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788838015.899045:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788838015.899132:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788838015.899365:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788838015.899384:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788838015.899398:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788838015.899411:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788838015.899426:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788838015.899444:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788838015.899457:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788838015.899470:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788838015.899484:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788838015.899499:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788838015.899513:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788838015.899528:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788838015.899560:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788838015.899572:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788838015.899586:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788838015.899600:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788838015.899614:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788838015.899627:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788838015.899640:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788838015.899653:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788838015.899667:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788838015.899680:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1788838015.899707:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1788838015.899723:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1788838015.899739:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1788838015.899753:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1788838015.899767:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1788838015.900360:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1788838015.900382:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1788838015.900396:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1788838015.900411:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1788838015.900426:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1788838015.900440:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1788838015.900453:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1788838015.900466:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1788838015.900479:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1788838015.900492:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1788838015.900505:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1788838015.900518:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1788838015.900532:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1788838015.900547:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1788838015.900574:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1788838015.900580:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1788838015.900698:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838015.900814:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838015.900853:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838015.901300:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037075584 00000100:00100000:2.0:1788838015.901309:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037075584 00000100:00100000:2.0:1788838015.901366:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788838015.901376:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+15:23493:x1875732037075584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838015.901527:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+15:23493:x1875732037075584:12345-0@lo:501:mount.lustre.0 Request processed in 153us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838015.901534:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788838015.901980:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838015.902019:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838015.902203:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838015.902344:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838015.902562:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037075712 00000100:00100000:3.0:1788838015.902568:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037075712 00000100:00100000:3.0:1788838015.902657:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788838015.902667:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+15:23493:x1875732037075712:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838015.903666:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+15:23493:x1875732037075712:12345-0@lo:503:mount.lustre.0 Request processed in 996us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838015.903698:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788838015.903811:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075712:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788838015.904303:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788838015.904381:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838015.904426:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838015.905208:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838015.905369:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037075840 00000100:00100000:2.0:1788838015.905377:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037075840 00000100:00100000:2.0:1788838015.905425:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788838015.905435:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+15:23493:x1875732037075840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838015.906638:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+15:23493:x1875732037075840:12345-0@lo:502:mount.lustre.0 Request processed in 1141us (2148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838015.906651:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788838015.906841:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788838015.907093:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788838015.907125:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1788838015.907433:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1788838015.907462:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1788838015.907478:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1788838015.907494:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1788838015.907508:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1788838015.907522:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1788838015.907538:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1788838015.907553:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1788838015.907571:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1788838015.907653:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1788838015.907668:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1788838015.907690:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1788838015.907708:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1788838015.907733:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1788838015.907749:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1788838015.907762:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1788838015.907802:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1788838015.907821:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1788838015.907833:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1788838015.907845:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1788838015.907856:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1788838015.907869:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1788838015.907882:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1788838015.908125:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1788838015.908141:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1788838015.908156:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1788838015.908168:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1788838015.908182:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1788838015.908198:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1788838015.908213:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1788838015.908308:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1788838015.908324:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1788838015.908338:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1788838015.908353:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1788838015.908367:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1788838015.908381:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1788838015.908396:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1788838015.908412:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1788838015.908425:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1788838015.908438:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1788838015.908452:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1788838015.908466:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1788838015.908515:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838015.908873:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838015.908976:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838015.909044:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037075968 00000100:00100000:2.0:1788838015.909117:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037075968 00000100:00100000:2.0:1788838015.909215:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788838015.909234:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aca1c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+15:23493:x1875732037075968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838015.909368:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aca1c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+15:23493:x1875732037075968:12345-0@lo:502:mount.lustre.0 Request processed in 136us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838015.909375:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788838015.909457:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037075968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788838015.909515:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1788838015.909525:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788838015.912389:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838015.912410:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838015.912413:0:23497:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788838015.912440:0:23497:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788838015.912444:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838015.912462:0:23497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8899c266cd28) 00000020:00000080:0.0:1788838015.912486:0:23497:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788838015.912493:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788838015.912574:0:23497:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788838015.912640:0:23497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af0a84 00000020:00000080:0.0:1788838015.913027:0:23497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788838015.913033:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838015.913037:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838015.913038:0:23497:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788838015.913042:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838015.913046:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838015.913047:0:23497:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788838015.913118:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838015.913128:0:23497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8899c266b370) 00000020:00000080:0.0:1788838015.913138:0:23497:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788838015.913143:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788838015.913144:0:23497:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788838015.913147:0:23497:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788838015.913152:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788838015.913198:0:23497:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8899c277b800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788838015.913209:0:23497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8899c26699b8) 00000020:00000080:0.0:1788838015.915348:0:23497:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788838015.915475:0:23497:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788838015.915485:0:23497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af0a99 00000020:00000080:0.0:1788838015.915643:0:23497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788838015.915650:0:23497:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788838015.915656:0:23497:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x57f6d4e926af0aa0 00080000:01000000:0.0:1788838015.915665:0:23497:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788838015.915668:0:23497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af0aa7 00010000:00010000:1.0:1788838015.980185:0:23497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788838015.980846:0:23497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1788838015.981303:0:23497:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788838015.982283:0:23497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788838015.982296:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838015.982309:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838015.982311:0:23497:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788838015.982316:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838015.982321:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838015.982322:0:23497:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788838015.982325:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788838015.982330:0:23497:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:00000080:0.0:1788838015.982358:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838015.982371:0:23497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8899c2668000) 00000020:00000080:0.0:1788838015.982392:0:23497:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788838015.982398:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788838015.982461:0:23497:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788838015.982468:0:23497:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788838015.982476:0:23497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af0ab5 00010000:00080000:0.0:1788838015.982508:0:23497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889ae7d3f800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788838015.984244:0:23497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788838015.989133:0:23497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788838015.989149:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788838015.989190:0:23497:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788838015.989213:0:23497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af0abc 00000100:00080000:0.0:1788838015.989224:0:23497:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788838015.989231:0:23497:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff889ae7d3f800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788838015.989265:0:23497:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4baaa00 x1875732037076096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838015.989297:0:23497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788838015.989355:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037076096:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838015.989427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838015.989503:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037076096 00000100:00100000:3.0:1788838015.989511:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037076096 00000100:00100000:3.0:1788838015.989544:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788838015.989551:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037076096:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788838015.989572:0:22768:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 632 last 0 00000020:00000080:3.0:1788838015.989606:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af0ac3 00000004:00100000:3.0:1788838015.989622:0:22768:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788838015.989627:0:22768:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1788838015.989714:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788838015.989719:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788838015.989721:0:38:0:(import.c:65:import_set_state_nolock()) ffff8899c2479000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838015.989726:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 629 00000100:00080000:3.0:1788838015.989730:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788838015.989735:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8899c2479000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788838015.989750:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4baf480 x1875732037076224/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838015.989765:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838015.989768:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838015.989771:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838015.989773:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788838015.989841:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037076352:0@lo:400:kworker.0 00000100:00100000:3.0:1788838015.989872:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838015.989905:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037076352 00000100:00100000:3.0:1788838015.989909:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037076352 00000100:00100000:3.0:1788838015.989939:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838015.989946:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037076352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838015.989991:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037076352:12345-0@lo:400:kworker.0 Request processed in 46us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838015.989998:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788838015.990035:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8899c4baf800 x1875732037076352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838015.990047:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037076352:0@lo:400:kworker.0 00000100:00100000:3.0:1788838015.990068:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037076224:0@lo:38:kworker.0 00000100:00100000:3.0:1788838015.990092:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838015.990118:0:22767:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788838015.990124:0:22767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788838015.990231:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037076224 00000100:00100000:3.0:1788838015.990234:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037076224 00000100:00100000:3.0:1788838015.990300:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788838015.990305:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875732037076224:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788838015.990342:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875732037076224:12345-0@lo:38:kworker.0 Request processed in 36us (249us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788838015.990348:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788838015.990367:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838015.990372:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c2479000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838015.990375:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788838015.990384:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037076224:0@lo:38:kworker.0 00000020:01000000:0.0:1788838015.998026:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838015.998036:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838015.998038:0:23497:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788838015.998042:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838015.998044:0:23497:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788838015.998046:0:23497:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838015.998226:0:23497:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838015.998229:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838015.998232:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838015.998234:0:23497:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838015.998237:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838015.998242:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838015.998243:0:23497:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788838015.998248:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788838015.998303:0:23497:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788838015.998320:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838015.998324:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838015.998325:0:23497:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788838015.998328:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838015.998330:0:23497:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788838015.998331:0:23497:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838015.998333:0:23497:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838015.998335:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838015.998337:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838015.998339:0:23497:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838015.998341:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788838015.998345:0:23497:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788838015.998348:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838015.998349:0:23497:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788838015.998353:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788838015.998357:0:23497:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:0.0:1788838015.998383:0:23497:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788838015.998386:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838015.998400:0:23497:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff889adeb7b370) 00000020:00000080:0.0:1788838015.998418:0:23497:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788838015.998424:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788838015.998485:0:23497:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788838015.998492:0:23497:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788838015.998498:0:23497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af0ad1 00010000:00080000:0.0:1788838015.998540:0:23497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889affb25800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788838015.999136:0:23497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1788838016.001265:0:23497:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788838016.003028:0:23497:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1788838016.005606:0:22768:0:(import.c:65:import_set_state_nolock()) ffff889af8dbd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838016.005723:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875732037076096:12345-0@lo:38:llog_process_th.0 Request processed in 16169us (16294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838016.005735:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788838016.006180:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838016.006191:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788838016.006199:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788838016.006205:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788838016.006208:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ae7d3f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788838016.006227:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037076096:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788838016.007035:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838016.007265:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037076480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838016.007327:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838016.007809:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037076480 00000100:00100000:3.0:1788838016.007817:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037076480 00000100:00100000:3.0:1788838016.007866:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788838016.007875:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1875732037076480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838016.007964:0:22767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788838016.008138:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1875732037076480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 264us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.008146:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788838016.008193:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037076480:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788838016.008643:0:23497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838016.011294:0:23497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788838016.011505:0:23497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788838016.011974:0:23504:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788838016.011979:0:23504:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788838016.012707:0:23497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788838016.012719:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788838016.012757:0:23497:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788838016.012807:0:23497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af0ad8 00000100:00080000:0.0:1788838016.012819:0:23497:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788838016.012825:0:23497:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff889affb25800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788838016.012861:0:23497:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4ba8380 x1875732037076608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838016.012895:0:23497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788838016.012947:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838016.012951:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838016.012953:0:23497:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788838016.012956:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838016.012959:0:23497:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788838016.012961:0:23497:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838016.012963:0:23497:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838016.012965:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838016.012968:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838016.012969:0:23497:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838016.012972:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788838016.012976:0:23497:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788838016.012980:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838016.012981:0:23497:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788838016.012985:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788838016.012994:0:23497:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:0.0:1788838016.013018:0:23497:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788838016.013021:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838016.013032:0:23497:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff889adeb7cd28) 00000020:00000080:0.0:1788838016.013044:0:23497:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000100:00100000:3.0:1788838016.013159:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037076608:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788838016.013211:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037076608 offset 0 length 520: 4 00000020:00000080:0.0:1788838016.013342:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788838016.013401:0:23497:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788838016.013408:0:23497:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788838016.013414:0:23497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af0ae6 00010000:00080000:0.0:1788838016.013443:0:23497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889ad20f0000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788838016.013651:0:23497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788838016.013729:0:23497:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788838016.013743:0:23497:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788838016.013868:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838016.013874:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788838016.013877:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838016.013880:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788838016.019345:0:23497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838016.019603:0:23497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788838016.019738:0:23497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788838016.021312:0:23506:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788838016.021318:0:23506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788838016.023246:0:23497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788838016.023261:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788838016.023308:0:23497:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788838016.023332:0:23497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af0aed 00000100:00080000:2.0:1788838016.023343:0:23497:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788838016.023349:0:23497:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889ad20f0000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788838016.023382:0:23497:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4ca80 x1875732037076736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838016.023408:0:23497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788838016.023437:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838016.023441:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788838016.023454:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838016.023457:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788838016.023499:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838016.023503:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838016.023505:0:23497:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788838016.023508:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838016.023511:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838016.023513:0:23497:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788838016.023516:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788838016.023517:0:23497:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788838016.023520:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838016.023522:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838016.023523:0:23497:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788838016.023525:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838016.023527:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838016.023528:0:23497:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788838016.023531:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788838016.023562:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838016.023565:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838016.023567:0:23497:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788838016.023570:0:23497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:3.0:1788838016.023724:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037076736:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788838016.023830:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037076736 offset 0 length 520: 4 00000020:01000000:1.0:1788838016.024193:0:23493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788838016.024226:0:23493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788838016.024247:0:23493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17000/0x57f6d4e926af0a6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a76 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838016.024258:0:23493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b17000/0x57f6d4e926af0a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0a76 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838016.024266:0:23493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8899c277b800 from 1 10000000:01000000:1.0:1788838016.024268:0:23493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788838016.024294:0:23493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838016.024303:0:23493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838016.024314:0:23493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838016.024345:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037076864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788838016.024385:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838016.024416:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac52300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838016.024479:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037076864 00000100:00100000:3.0:1788838016.024486:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037076864 00000100:00100000:3.0:1788838016.024528:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788838016.024537:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aca1c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+15:23493:x1875732037076864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838016.024559:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838016.024572:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c2229400/0x57f6d4e926af0afb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0af4 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.024594:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2229400/0x57f6d4e926af0afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0af4 expref: 16 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.024605:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c2229400/0x57f6d4e926af0afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0af4 expref: 16 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.024613:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2229400, rc 0) 00000100:00100000:3.0:1788838016.024658:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aca1c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+16:23493:x1875732037076864:12345-0@lo:101:mount.lustre.0 Request processed in 121us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.024664:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788838016.024809:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037076864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838016.024823:0:23493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838016.024832:0:23493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838016.025576:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037076992:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788838016.025616:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838016.025650:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac52300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838016.026140:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037076992 00000100:00100000:3.0:1788838016.026148:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037076992 00000100:00100000:3.0:1788838016.026183:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788838016.026191:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+16:23493:x1875732037076992:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788838016.026208:0:22756:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788838016.026227:0:22756:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788838016.026230:0:22756:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788838016.026321:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+16:23493:x1875732037076992:12345-0@lo:256:mount.lustre.0 Request processed in 129us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.026328:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788838016.026370:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037076992:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788838016.028504:0:23493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788838016.028595:0:23493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.028666:0:23493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838016.028673:0:23493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8899c277b800 from 1 10000000:01000000:3.0:1788838016.028676:0:23493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838016.028722:0:23493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.028729:0:23493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.028740:0:23493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838016.028764:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838016.028854:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838016.028911:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae306c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838016.029086:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037077120 00000100:00100000:0.0:1788838016.029094:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037077120 00000100:00100000:0.0:1788838016.029147:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788838016.029156:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+16:23493:x1875732037077120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838016.029169:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838016.029183:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0b09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0b02 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838016.029206:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0b09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0b02 expref: 17 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838016.029215:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0b09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b02 expref: 17 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838016.029231:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17a00, rc 0) 00000100:00100000:0.0:1788838016.029280:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:23493:x1875732037077120:12345-0@lo:101:mount.lustre.0 Request processed in 125us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838016.029287:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788838016.029425:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838016.029439:0:23493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838016.029447:0:23493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788838016.030491:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1788838016.030757:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838016.030954:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788838016.030978:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1788838016.030991:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1788838016.031005:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1788838016.031028:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1788838016.031040:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1788838016.031178:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1788838016.031193:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1788838016.031204:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788838016.031215:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1788838016.031228:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1788838016.031245:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1788838016.031250:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1788838016.031317:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838016.031374:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838016.031421:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230240 going to sleep for 11 seconds 00000100:00100000:0.0:1788838016.031514:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037077248 00000100:00100000:0.0:1788838016.031521:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037077248 00000100:00100000:0.0:1788838016.031568:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788838016.031578:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:23493:x1875732037077248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838016.031701:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:23493:x1875732037077248:12345-0@lo:501:mount.lustre.0 Request processed in 124us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838016.031709:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788838016.032969:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838016.033020:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838016.033199:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838016.033234:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230240 going to sleep for 11 seconds 00000100:00100000:0.0:1788838016.033534:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037077376 00000100:00100000:0.0:1788838016.033541:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037077376 00000100:00100000:0.0:1788838016.033580:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788838016.033589:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:23493:x1875732037077376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838016.033732:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:23493:x1875732037077376:12345-0@lo:503:mount.lustre.0 Request processed in 143us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838016.033740:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788838016.034558:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077376:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788838016.035122:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788838016.035223:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838016.035278:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838016.035316:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037077504 00000100:00100000:3.0:1788838016.035321:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037077504 00000100:00100000:3.0:1788838016.035355:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788838016.035363:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:23493:x1875732037077504:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838016.035445:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:23493:x1875732037077504:12345-0@lo:502:mount.lustre.0 Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.035458:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788838016.035501:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae30840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838016.035516:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788838016.035700:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788838016.035725:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1788838016.035737:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1788838016.035748:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1788838016.035760:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1788838016.035773:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1788838016.035812:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1788838016.035825:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1788838016.035841:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788838016.035854:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1788838016.035867:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1788838016.035887:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838016.035921:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838016.035941:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037077632 00000100:00100000:3.0:1788838016.035945:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037077632 00000100:00100000:3.0:1788838016.035967:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788838016.035972:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:23493:x1875732037077632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838016.036031:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:23493:x1875732037077632:12345-0@lo:502:mount.lustre.0 Request processed in 58us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.036037:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788838016.038074:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae30840 going to sleep for 11 seconds 00000100:00100000:0.0:1788838016.038112:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838016.038212:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1788838016.038225:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788838016.039279:0:23508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838016.039290:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838016.039293:0:23508:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788838016.039306:0:23508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8899c277b800 00000020:00000080:0.0:1788838016.039309:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838016.039316:0:23508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838016.039319:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838016.039320:0:23508:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788838016.039323:0:23508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838016.039325:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838016.039326:0:23508:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788838016.039329:0:23508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8899c277b800 00000020:00000080:0.0:1788838016.039331:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838016.039431:0:23508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838016.039435:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838016.039437:0:23508:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788838016.039439:0:23508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838016.039441:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838016.039442:0:23508:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788838016.039446:0:23508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8899c277b800 00000020:00000080:0.0:1788838016.039447:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838016.049071:0:23508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838016.049827:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838016.049832:0:23508:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788838016.049838:0:23508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838016.049843:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838016.049844:0:23508:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788838016.049849:0:23508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8899c277b800 00000020:00000080:2.0:1788838016.049851:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788838016.049941:0:23508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838016.049944:0:23508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838016.049946:0:23508:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788838016.049948:0:23508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1788838016.059846:0:23493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788838016.059898:0:23493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788838016.059919:0:23493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838016.059931:0:23493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838016.059992:0:23493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788838016.059996:0:23493:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8899c277b800 10000000:01000000:2.0:1788838016.059998:0:23493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8899c277b800 10000000:01000000:2.0:1788838016.060003:0:23493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788838016.060008:0:23493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8899c277b800 from 1 10000000:01000000:2.0:1788838016.060011:0:23493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788838016.060058:0:23493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926af0b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838016.060068:0:23493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926af0b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838016.060079:0:23493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926af0b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838016.060106:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838016.060170:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838016.060215:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f7f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788838016.060447:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037077760 00000100:00100000:1.0:1788838016.060455:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037077760 00000100:00100000:1.0:1788838016.060576:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788838016.060587:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:23493:x1875732037077760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838016.060600:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838016.060613:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af0b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0b10 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838016.060636:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af0b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0b10 expref: 18 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838016.060647:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af0b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b10 expref: 18 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838016.060669:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a800, rc 0) 00000100:00100000:1.0:1788838016.060727:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037077760:12345-0@lo:101:mount.lustre.0 Request processed in 142us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838016.060733:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788838016.060811:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838016.060825:0:23493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926af0b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b17 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838016.060845:0:23493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926af0b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0b17 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788838016.062376:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788838016.062631:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788838016.062858:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788838016.062884:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788838016.062915:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788838016.062928:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788838016.062942:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788838016.062953:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788838016.062965:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788838016.062977:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788838016.062989:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788838016.063002:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788838016.063038:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788838016.063162:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788838016.063180:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788838016.063192:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788838016.063202:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788838016.063215:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788838016.063228:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788838016.063240:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788838016.063250:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788838016.063261:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788838016.063272:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788838016.063284:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788838016.063296:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788838016.063308:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788838016.063320:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788838016.063343:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788838016.063370:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788838016.063386:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788838016.063399:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788838016.063411:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788838016.063423:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788838016.063435:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788838016.063447:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788838016.063461:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788838016.063474:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788838016.063486:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788838016.063498:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788838016.063511:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788838016.063523:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788838016.063536:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788838016.063548:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788838016.063561:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788838016.063585:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788838016.063600:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788838016.063614:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788838016.063627:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788838016.063641:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788838016.063654:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788838016.063827:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788838016.063847:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788838016.063864:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788838016.063870:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788838016.064026:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838016.064159:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838016.064422:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae1343d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838016.064515:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037077888 00000100:00100000:3.0:1788838016.064523:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037077888 00000100:00100000:3.0:1788838016.064562:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788838016.064571:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037077888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838016.064722:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037077888:12345-0@lo:501:mount.lustre.0 Request processed in 150us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.064731:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788838016.064848:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037077888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838016.064899:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037078016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838016.064940:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838016.064963:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae1343d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838016.065320:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037078016 00000100:00100000:3.0:1788838016.065325:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037078016 00000100:00100000:3.0:1788838016.065345:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788838016.065352:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037078016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838016.065438:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037078016:12345-0@lo:503:mount.lustre.0 Request processed in 85us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.065445:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788838016.066599:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037078016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788838016.067154:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788838016.067226:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037078144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838016.067282:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838016.072355:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037078144 00000100:00100000:0.0:1788838016.072370:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037078144 00000100:00100000:1.0:1788838016.072435:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae1343d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838016.072560:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788838016.072570:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037078144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838016.072732:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037078144:12345-0@lo:502:mount.lustre.0 Request processed in 163us (5449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.072739:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788838016.073016:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037078144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838016.073284:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788838016.073317:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1788838016.073337:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1788838016.073350:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1788838016.073361:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1788838016.073373:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1788838016.073385:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1788838016.073397:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1788838016.073410:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788838016.073420:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1788838016.073432:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1788838016.073455:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1788838016.073469:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1788838016.073482:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1788838016.073494:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1788838016.073506:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1788838016.073518:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1788838016.073530:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1788838016.073541:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1788838016.073553:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1788838016.073564:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1788838016.073592:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1788838016.073607:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1788838016.073620:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1788838016.073631:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1788838016.073643:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1788838016.073656:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1788838016.073669:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1788838016.073699:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1788838016.073711:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1788838016.073723:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1788838016.073734:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1788838016.073745:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1788838016.073757:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1788838016.073772:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1788838016.073816:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1788838016.073829:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1788838016.073854:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1788838016.073868:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1788838016.073881:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1788838016.073908:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1788838016.073922:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1788838016.073935:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1788838016.073948:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1788838016.073970:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1788838016.073984:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1788838016.073997:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1788838016.074008:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1788838016.074053:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037078272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838016.074110:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838016.074535:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788838016.074568:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037078272 00000100:00100000:1.0:1788838016.074575:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037078272 00000100:00100000:1.0:1788838016.074613:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788838016.074621:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037078272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838016.074914:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037078272:12345-0@lo:502:mount.lustre.0 Request processed in 290us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838016.074921:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788838016.075172:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037078272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838016.075344:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1788838016.075369:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1788838016.075395:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037078400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838016.075431:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838016.075449:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838016.075500:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037078400 00000100:00100000:3.0:1788838016.075505:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037078400 00000100:00100000:3.0:1788838016.075531:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788838016.075537:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037078400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838016.075624:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037078400:12345-0@lo:502:mount.lustre.0 Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.075631:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788838016.077036:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037078400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838016.077182:0:23493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1788838016.077197:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788838016.083191:0:23513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788838016.083210:0:23513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8899c3d319b8) 00000020:00000080:3.0:1788838016.083232:0:23513:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788838016.083320:0:23513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8899c277b800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788838016.083328:0:23513:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8899c277b800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788838016.083331:0:23513:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8899c277b800 3 00010000:00080000:3.0:1788838016.083360:0:23513:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889afa766800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788838016.087428:0:23513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788838016.087629:0:23513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788838016.087673:0:23513:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788838016.087697:0:23513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x57f6d4e926af0b25 00000100:00080000:3.0:1788838016.087708:0:23513:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788838016.087714:0:23513:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff889afa766800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788838016.087752:0:23513:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4baed80 x1875732037078528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838016.087818:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875732037078528:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838016.088373:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838016.090019:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037078528 00000100:00100000:2.0:1788838016.090030:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037078528 00000100:00100000:2.0:1788838016.090087:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788838016.090095:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875732037078528:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788838016.090120:0:22764:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 632 last 0 00000020:00000080:2.0:1788838016.090168:0:22764:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x57f6d4e926af0b2c 00000004:00100000:2.0:1788838016.090183:0:22764:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788838016.090211:0:22764:0:(import.c:65:import_set_state_nolock()) ffff889af8df9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838016.090292:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875732037078528:12345-0@lo:38:llog_process_th.0 Request processed in 196us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838016.090299:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788838016.090502:0:23513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788838016.090525:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838016.090529:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788838016.090533:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838016.090536:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1788838016.090849:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8899c4baed80 x1875732037078528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838016.090862:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838016.090870:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788838016.090877:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788838016.090882:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788838016.090893:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889afa766800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788838016.090899:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875732037078528:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788838016.091189:0:23513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1788838016.091462:0:23493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788838016.091495:0:23493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838016.091509:0:23493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926af0b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b17 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838016.091520:0:23493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926af0b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b17 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788838016.091565:0:23493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788838016.091568:0:23493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788838016.091569:0:23493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838016.091571:0:23493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838016.091573:0:23493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838016.091574:0:23493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838016.091576:0:23493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788838016.091578:0:23493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838016.091579:0:23493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788838016.091586:0:23493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788838016.091589:0:23493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788838016.091590:0:23493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788838016.091591:0:23493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838016.091592:0:23493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838016.091594:0:23493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838016.091594:0:23493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838016.091595:0:23493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788838016.091596:0:23493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838016.091597:0:23493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788838016.091615:0:23493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788838016.091631:0:23493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037078656:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788838016.091689:0:23493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838016.091725:0:23493:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad99fb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788838016.092144:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037078656 00000100:00100000:3.0:1788838016.092151:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037078656 00000100:00100000:3.0:1788838016.092198:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788838016.092207:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037078656:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788838016.092233:0:22756:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788838016.092245:0:22756:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788838016.096275:0:22742:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788838016.096310:0:22756:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788838016.096321:0:22756:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788838016.096364:0:22778:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788838016.096368:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788838016.096391:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.096411:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af0a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0a30 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.096430:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c2229400/0x57f6d4e926af0afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0af4 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.096437:0:22778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.096472:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c2229400/0x57f6d4e926af0afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0af4 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.096486:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c2229400/0x57f6d4e926af0afb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0af4 expref: 18 pid: 22757 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838016.096499:0:22778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bac000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037078784:0@lo:104: 00000100:00100000:3.0:1788838016.096562:0:22778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788838016.096609:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af0a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0a30 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.096617:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af0a37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0a30 expref: 18 pid: 22757 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838016.096625:0:22778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037078912:0@lo:104: 00000100:00100000:3.0:1788838016.096646:0:22778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838016.096663:0:22778:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c33d80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838016.098824:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037078784 00000100:00100000:3.0:1788838016.098838:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037078784 00000100:00100000:3.0:1788838016.099286:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037078912 00000100:00100000:3.0:1788838016.099290:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037078912 00000100:00100000:3.0:1788838016.099315:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838016.099325:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+4:22778:x1875732037078784:12345-0@lo:104: 00010000:00010000:3.0:1788838016.099351:0:22745:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099445:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788838016.099451:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+4:22778:x1875732037078784:12345-0@lo:104: Request processed in 129us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.099459:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838016.099475:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788838016.099481:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:22778:x1875732037078912:12345-0@lo:104: 00010000:00010000:3.0:1788838016.099490:0:22745:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099521:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788838016.099526:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:22778:x1875732037078912:12345-0@lo:104: Request processed in 46us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.099533:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788838016.099552:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838016.099558:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099566:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a000 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788838016.099570:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099579:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838016.099586:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838016.099598:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838016.099634:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099640:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838016.099658:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099665:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0af4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0afb expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099677:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838016.099690:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099695:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229200 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788838016.099698:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099704:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838016.099710:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838016.099715:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838016.099727:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099733:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838016.099753:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099759:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c2229200/0x57f6d4e926af0a30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0a37 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.099795:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838016.099797:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838016.099799:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838016.099804:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838016.099823:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037079040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838016.099860:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838016.100855:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:23493:x1875732037078656:12345-0@lo:253:mount.lustre.0 Request processed in 8645us (9170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838016.100871:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788838016.101008:0:22778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bac000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037078784:0@lo:104: 00000100:00100000:2.0:1788838016.101028:0:22778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037078912:0@lo:104: 00000100:00100000:0.0:1788838016.101148:0:23493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:23493:1875732037078656:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788838016.101163:0:23493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788838016.101167:0:23493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788838016.101169:0:23493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788838016.101170:0:23493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838016.101171:0:23493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838016.101172:0:23493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838016.101173:0:23493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838016.101174:0:23493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838016.101176:0:23493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838016.101177:0:23493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788838016.101188:0:23493:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788838016.102029:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037079168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838016.102984:0:22778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838016.103151:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838016.103216:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037079040 00000100:00100000:3.0:1788838016.103225:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037079040 00010000:00010000:3.0:1788838016.103256:0:22747:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c2229400/0x57f6d4e926af0afb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0af4 expref: 18 pid: 22757 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838016.103283:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037079168 00000100:00100000:3.0:1788838016.103286:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037079168 00010000:00010000:3.0:1788838016.103298:0:22747:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af0a37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0a30 expref: 19 pid: 22757 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838016.103310:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838016.103318:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4badc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:3649:x1875732037079040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838016.103332:0:22747:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838016.103337:0:22747:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c2229400/0x57f6d4e926af0afb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0af4 expref: 19 pid: 22757 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103359:0:22747:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c2229400/0x57f6d4e926af0afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0af4 expref: 19 pid: 22757 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103376:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c2229400/0x57f6d4e926af0afb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0af4 expref: 19 pid: 22757 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103392:0:22747:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838016.103427:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4badc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:3649:x1875732037079040:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (3566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.103434:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838016.103451:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788838016.103457:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:3650:x1875732037079168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838016.103465:0:22747:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838016.103468:0:22747:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af0a37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0a30 expref: 17 pid: 22757 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103477:0:22747:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af0a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0a30 expref: 17 pid: 22757 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103486:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af0a37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0a30 expref: 17 pid: 22757 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103497:0:22747:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103505:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788838016.103518:0:22747:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007150725s 00010000:00010000:3.0:1788838016.103528:0:22747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103535:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103541:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103547:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103553:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2228400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838016.103557:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103565:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103581:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.103591:0:22747:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838016.103619:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+16:3650:x1875732037079168:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.103626:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788838016.106002:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037079040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838016.106141:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037079168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838016.106167:0:22778:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.106191:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838016.106198:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0b33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1788838016.107160:0:23493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788838016.109894:0:23518:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788838016.109903:0:23518:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788838016.110201:0:23519:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788838016.110604:0:23519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788838016.112828:0:23493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788838016.113304:0:23519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788838016.113377:0:23519:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788838016.116110:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23521:1875732037079296:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788838016.116192:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838016.116221:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f06c0 going to sleep for 11 seconds 00000040:01000000:1.0:1788838016.117123:0:23493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788838016.117165:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788838016.117586:0:23493:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788838016.117593:0:23493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788838016.117625:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838016.118620:0:23493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788838016.119177:0:23493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788838016.119208:0:23493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788838016.119296:0:23493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788838016.119833:0:23493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:1.0:1788838016.120057:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037079296 00000100:00100000:1.0:1788838016.120067:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037079296 00000100:00100000:1.0:1788838016.120125:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788838016.120135:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23521:x1875732037079296:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788838016.120261:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23521:x1875732037079296:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 127us (4068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838016.120275:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838016.121876:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23521:1875732037079296:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788838016.121927:0:23521:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788838016.121976:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23521:1875732037079424:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788838016.122035:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838016.122074:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838016.123626:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037079424 00000100:00100000:3.0:1788838016.123637:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037079424 00000100:00100000:3.0:1788838016.123700:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788838016.123710:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23521:x1875732037079424:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788838016.124141:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23521:x1875732037079424:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 431us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838016.124150:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788838016.124201:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838016.124586:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23521:1875732037079424:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788838016.124671:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23521:1875732037079552:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788838016.124731:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838016.125991:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad8689780 going to sleep for 11 seconds 00000001:00000004:2.0:1788838016.126576:0:23493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1788838016.128244:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037079552 00000100:00100000:0.0:1788838016.128256:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037079552 00000100:00100000:0.0:1788838016.128325:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788838016.128335:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23521:x1875732037079552:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788838016.128426:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23521:x1875732037079552:12345-0@lo:900:lod0001_rec0000.0 Request processed in 91us (3692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838016.128433:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788838016.128538:0:23521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8899c4bae680 x1875732037079552/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788838032 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838016.128552:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23521:1875732037079552:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788838016.128623:0:23521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23521:1875732037079680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788838016.128663:0:23521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838016.128709:0:23521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad8689900 going to sleep for 11 seconds 00000100:00100000:0.0:1788838016.129293:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037079680 00000100:00100000:0.0:1788838016.129298:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037079680 00000100:00100000:0.0:1788838016.129339:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788838016.129347:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23521:x1875732037079680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788838016.129420:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23521:x1875732037079680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 74us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838016.129427:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788838016.129731:0:23521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23521:1875732037079680:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788838016.135023:0:23521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838016.137246:0:23521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788838016.137332:0:23521:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788838016.137337:0:23521:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1788838016.139001:0:23493:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788838016.139037:0:23493:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa3bc816bf988 00100000:10000000:0.0:1788838016.140166:0:23493:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788838016.141871:0:23493:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788838016.142010:0:23493:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788838016.142041:0:23493:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788838016.142066:0:23493:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788838016.142874:0:23493:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838016.147304:0:23493:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788838016.572850:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788838017.149140:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788838017.156816:0:23520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788838017.593056:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 10000000:01000000:3.0:1788838017.978058:0:22759:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788838017.978067:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8899c277b800 from 12 10000000:01000000:3.0:1788838017.978073:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788838017.978126:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838017.978139:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838017.978151:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838017.978180:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037079808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838017.978258:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838017.978315:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad86896c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838017.978385:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037079808 00000100:00100000:0.0:1788838017.978393:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037079808 00000100:00100000:0.0:1788838017.978450:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788838017.978459:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+16:22759:x1875732037079808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838017.978472:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838017.978486:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926af0b41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0b3a expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838017.978511:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926af0b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0b3a expref: 17 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838017.978522:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926af0b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b3a expref: 17 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838017.978550:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16c00, rc 0) 00000100:00100000:0.0:1788838017.978592:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:22759:x1875732037079808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838017.978599:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788838017.978972:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037079808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838017.978987:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838017.978996:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838017.979046:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037079936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788838017.979075:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838017.979108:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad86896c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838017.979148:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037079936 00000100:00100000:0.0:1788838017.979153:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037079936 00000100:00100000:0.0:1788838017.979186:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788838017.979193:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:22759:x1875732037079936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788838017.979209:0:22756:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788838017.979224:0:22756:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788838017.979227:0:22756:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788838017.979302:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:22759:x1875732037079936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838017.979309:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788838017.979373:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037079936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788838017.979419:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788838017.979427:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838017.979435:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838017.979444:0:22759:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788838017.979446:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8899c30c6000 from 12 10000000:01000000:3.0:1788838017.979448:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788838017.979478:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838017.979485:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838017.979493:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838017.979504:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037080064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838017.979528:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838017.979552:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad86896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838017.979564:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037080064 00000100:00100000:3.0:1788838017.979567:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037080064 00000100:00100000:3.0:1788838017.979589:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788838017.979595:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:22759:x1875732037080064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838017.979612:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838017.979628:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0b4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0b48 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838017.979644:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0b48 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838017.979664:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b48 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838017.979671:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2229200, rc 0) 00000100:00100000:3.0:1788838017.979703:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:22759:x1875732037080064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838017.979709:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788838017.979751:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037080064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838017.979761:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838017.979767:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838017.979829:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037080192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788838017.979857:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838017.979869:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad86896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838017.979878:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037080192 00000100:00100000:3.0:1788838017.979882:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037080192 00000100:00100000:3.0:1788838017.979903:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788838017.979908:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:22759:x1875732037080192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788838017.979919:0:22757:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788838017.979934:0:22757:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788838017.979936:0:22757:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788838017.979994:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:22759:x1875732037080192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838017.980002:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788838017.980029:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037080192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788838017.980062:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788838017.980067:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838017.980074:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788838018.174321:0:23520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788838018.175280:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838018.621307:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788838019.193552:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838019.641256:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788838020.218970:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838020.666187:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 0 seconds 00000001:02000400:3.0:1788838020.900967:0:23763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788838021.052876:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838021.052903:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037080320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838021.052973:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838021.053613:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037080320 00000100:00100000:1.0:1788838021.053622:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037080320 00000100:00100000:1.0:1788838021.053683:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788838021.053693:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037080320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788838021.053728:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788838021.053960:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037080320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 268us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838021.053968:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788838021.054021:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037080320:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788838021.241986:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788838021.561904:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788838021.561912:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788838021.561916:0:37:0:(import.c:65:import_set_state_nolock()) ffff8899c2479000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838021.561928:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8899c2479000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788838021.561954:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4e680 x1875732037080576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838021.561974:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838021.561978:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788838021.561980:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838021.561983:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788838021.562126:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037080448:0@lo:400:kworker.0 00000100:00100000:0.0:1788838021.562198:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838021.562255:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838021.562261:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037080704:0@lo:400:kworker.0 00000100:00100000:0.0:1788838021.562292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838021.562325:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037080448 00000100:00100000:0.0:1788838021.562332:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037080448 00000100:00100000:0.0:1788838021.562379:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788838021.562388:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:3648:x1875732037080448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838021.562435:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:3648:x1875732037080448:12345-0@lo:400:kworker.0 Request processed in 47us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838021.562450:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788838021.562486:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037080704 00000100:00100000:0.0:1788838021.562490:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037080704 00000100:00100000:0.0:1788838021.562517:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788838021.562523:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037080704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838021.562554:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037080704:12345-0@lo:400:kworker.0 Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838021.562560:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788838021.562605:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889affc4e300 x1875732037080704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838021.562620:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037080704:0@lo:400:kworker.0 00000100:00100000:0.0:1788838021.562630:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037080448:0@lo:400:kworker.0 00000100:00080000:2.0:1788838021.563736:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838021.563743:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788838021.563758:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838021.563761:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788838021.563826:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037080576:0@lo:38:kworker.0 00000100:00100000:2.0:1788838021.563871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838021.563916:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037080832:0@lo:400:kworker.0 00000100:00100000:2.0:1788838021.563942:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838021.563961:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838021.563967:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037080960:0@lo:400:kworker.0 00000100:00100000:2.0:1788838021.563994:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838021.564851:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037080576 00000100:00100000:0.0:1788838021.564861:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037080576 00000100:00100000:0.0:1788838021.564893:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037080832 00000100:00100000:0.0:1788838021.564898:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037080832 00000100:00100000:0.0:1788838021.564922:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788838021.564929:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875732037080576:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788838021.564956:0:23503:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 638 last 0 00000020:00000080:0.0:1788838021.564991:0:23503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af0b56 00000004:00100000:0.0:1788838021.565006:0:23503:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788838021.565012:0:23503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1788838021.565504:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037080960 00000100:00100000:0.0:1788838021.565509:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037080960 00000100:00100000:0.0:1788838021.565548:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788838021.565567:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037080960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838021.566168:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788838021.566181:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037080832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838021.566967:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037080960:12345-0@lo:400:kworker.0 Request processed in 1398us (2969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838021.566977:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788838021.577399:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037080832:12345-0@lo:400:kworker.0 Request processed in 11212us (13445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838021.577416:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788838021.578415:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889affc4ea00 x1875732037080960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838021.578434:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037080960:0@lo:400:kworker.0 00000100:00100000:1.0:1788838021.578453:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037080832:0@lo:400:kworker.0 00000100:00080000:0.0:1788838021.584006:0:23503:0:(import.c:65:import_set_state_nolock()) ffff889ae7d3a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838021.584389:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875732037080576:12345-0@lo:38:kworker.0 Request processed in 19458us (20516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838021.584402:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788838021.584420:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788838021.584432:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788838021.584438:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788838021.584441:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c2479000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788838021.584462:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000076ef2851): req@ffff8899c4baad80 x1875732037073536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838021.584488:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037080576:0@lo:38:kworker.0 00000100:00100000:3.0:1788838021.584607:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838021.584623:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037081088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838021.584662:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838021.585165:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838021.585184:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838021.585198:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037081088 00000100:00100000:0.0:1788838021.585204:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037081088 00000100:00100000:0.0:1788838021.586365:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037073536 00000100:00100000:0.0:1788838021.586377:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037073536 00000100:00100000:0.0:1788838021.586413:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788838021.586423:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1875732037081088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788838021.586460:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788838021.586528:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1875732037081088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838021.586535:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788838021.586551:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788838021.586557:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22804:x1875732037073536:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788838021.586755:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037081088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838021.589796:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22804:x1875732037073536:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 3214us (4606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838021.589814:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788838021.591212:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22804:1875732037073536:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788838021.591271:0:22804:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788838021.591318:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22804:1875732037081216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788838021.591376:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838021.591410:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad8689cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838021.591538:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037081216 00000100:00100000:0.0:1788838021.591545:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037081216 00000100:00100000:0.0:1788838021.591610:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788838021.591619:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22804:x1875732037081216:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838021.591744:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22804:x1875732037081216:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 126us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838021.591751:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788838021.591984:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22804:1875732037081216:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788838021.592476:0:22804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22804:1875732037081344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788838021.592506:0:22804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838021.592529:0:22804:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad8689cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838021.593070:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037081344 00000100:00100000:0.0:1788838021.593077:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037081344 00000100:00100000:0.0:1788838021.593114:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788838021.593122:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22804:x1875732037081344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838021.593202:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22804:x1875732037081344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838021.593209:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788838021.596344:0:22804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22804:1875732037081344:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788838021.596423:0:22804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838021.598516:0:22804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788838021.598618:0:22804:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1788838021.598623:0:22804:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1788838021.966204:0:23815:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788838021.966385:0:23815:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788838022.267052:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788838022.943552:0:23865:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788838022.943969:0:23865:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788838023.289872:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788838024.043729:0:23914:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb3d6bb70 20000000:00000080:2.0:1788838024.043747:0:23914:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff889ae44b0400 uarg=0000000000000000 20000000:01000000:2.0:1788838024.043964:0:23914:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788838024.044093:0:23914:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788838024.044099:0:23914:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788838024.044764:0:23915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788838024.044968:0:23914:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788838024.050275:0:23914:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788838024.050307:0:23914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838024.050326:0:23914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c2228a00/0x57f6d4e926af0a06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af09ff expref: 17 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838024.050333:0:23914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0b09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b02 expref: 17 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838024.050340:0:23914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838024.050386:0:23914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0b09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0b02 expref: 17 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838024.050463:0:23914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0b09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0b02 expref: 17 pid: 22755 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838024.050477:0:23914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23914:1875732037081472:0@lo:104: 00000100:00100000:2.0:1788838024.050553:0:23914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788838024.050612:0:23914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c2228a00/0x57f6d4e926af0a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af09ff expref: 17 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838024.050620:0:23914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c2228a00/0x57f6d4e926af0a06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af09ff expref: 17 pid: 22757 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838024.050640:0:23914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23914:1875732037081600:0@lo:104: 00000100:00100000:2.0:1788838024.050669:0:23914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838024.050740:0:23914:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f76b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838024.051683:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037081472 00000100:00100000:0.0:1788838024.051693:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037081472 00000100:00100000:0.0:1788838024.051732:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037081600 00000100:00100000:0.0:1788838024.051735:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037081600 00000100:00100000:0.0:1788838024.051863:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788838024.051874:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+4:23914:x1875732037081472:12345-0@lo:104: 00010000:00010000:0.0:1788838024.051887:0:22745:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838024.052206:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788838024.052214:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+4:23914:x1875732037081472:12345-0@lo:104: Request processed in 343us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838024.052222:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788838024.052255:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788838024.052262:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:23914:x1875732037081600:12345-0@lo:104: 00010000:00010000:0.0:1788838024.052270:0:22745:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.052465:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838024.052473:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.052482:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229a00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788838024.052493:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.052502:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838024.052511:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838024.052517:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788838024.052569:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.052576:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838024.052599:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.052607:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c2229a00/0x57f6d4e926af0b02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b09 expref: -99 pid: 23493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.052624:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838024.052627:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.052634:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788838024.052637:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.052644:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838024.052662:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838024.052668:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788838024.052682:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.052689:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838024.052703:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.052710:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926af09ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0a06 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.052722:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838024.052724:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838024.052726:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838024.052741:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037081728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838024.052817:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838024.052864:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037081856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838024.052889:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838024.052921:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037081728 00000100:00100000:1.0:1788838024.052926:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037081728 00010000:00010000:1.0:1788838024.052948:0:22749:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0b09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0b02 expref: 18 pid: 22755 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838024.052971:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037081856 00000100:00100000:1.0:1788838024.052974:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037081856 00010000:00010000:1.0:1788838024.052993:0:22749:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c2228a00/0x57f6d4e926af0a06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af09ff expref: 19 pid: 22757 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838024.053006:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788838024.053013:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:3649:x1875732037081728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838024.053023:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838024.053029:0:22749:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0b09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0b02 expref: 19 pid: 22755 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053040:0:22749:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0b09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0b02 expref: 19 pid: 22755 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053058:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838024.053084:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:3649:x1875732037081728:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838024.053090:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788838024.053103:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788838024.053109:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:3650:x1875732037081856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838024.053117:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838024.053121:0:22749:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c2228a00/0x57f6d4e926af0a06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af09ff expref: 18 pid: 22757 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053131:0:22749:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c2228a00/0x57f6d4e926af0a06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af09ff expref: 18 pid: 22757 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053143:0:22749:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053152:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053176:0:22749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053184:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053192:0:22749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053199:0:22749:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053205:0:22749:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788838024.053209:0:22749:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053217:0:22749:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053226:0:22749:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838024.053235:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838024.053261:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:3650:x1875732037081856:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838024.053268:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788838024.053299:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037081856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838024.053322:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037081728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838024.053499:0:23914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0b09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0b02 expref: 17 pid: 22755 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838024.053512:0:23914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23914:1875732037081472:0@lo:104: 00010000:00010000:2.0:1788838024.053528:0:23914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c2228a00/0x57f6d4e926af0a06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af09ff expref: 16 pid: 22757 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838024.053536:0:23914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23914:1875732037081600:0@lo:104: 00010000:00010000:2.0:1788838024.053569:0:23914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838024.053578:0:23914:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838024.053585:0:23914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838024.053591:0:23914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6da400/0x57f6d4e926af0b5d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838024.054828:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788838024.054843:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:23914:x1875732037081600:12345-0@lo:104: Request processed in 2579us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838024.054853:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788838024.054947:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838024.313421:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788838024.763827:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788838025.339581:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788838025.529181:0:22759:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788838025.529189:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8899c277b800 from 13 10000000:01000000:3.0:1788838025.529194:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838025.529240:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838025.529251:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838025.529261:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838025.529286:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037081984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838025.529354:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838025.529399:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788838025.529523:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037081984 00000100:00100000:0.0:1788838025.529532:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037081984 00000100:00100000:0.0:1788838025.529589:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788838025.529599:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+16:22759:x1875732037081984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838025.529613:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838025.529626:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926af0b6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0b64 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838025.529652:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926af0b6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0b64 expref: 17 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838025.529662:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926af0b6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b64 expref: 17 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838025.529671:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17c00, rc 0) 00000100:00100000:0.0:1788838025.529731:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:22759:x1875732037081984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838025.529739:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788838025.530322:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037081984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838025.530341:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838025.530365:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838025.530431:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037082112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838025.530473:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838025.530508:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad8689540 going to sleep for 11 seconds 00000100:00100000:3.0:1788838025.530586:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037082112 00000100:00100000:3.0:1788838025.530591:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037082112 00000100:00100000:3.0:1788838025.530629:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788838025.530636:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:22759:x1875732037082112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838025.530771:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:22759:x1875732037082112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838025.530804:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788838025.532503:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037082112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838025.532573:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037082240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838025.532643:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838025.532694:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad8689540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838025.532755:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037082240 00000100:00100000:0.0:1788838025.532770:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037082240 00000100:00100000:0.0:1788838025.532839:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788838025.532848:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:22759:x1875732037082240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838025.532976:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:22759:x1875732037082240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838025.532982:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788838025.533219:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037082240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788838025.534354:0:23983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788838025.535470:0:22759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788838025.535503:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838025.535525:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838025.535538:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838025.535549:0:22759:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788838025.535553:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8899c30c6000 from 13 10000000:01000000:0.0:1788838025.535556:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788838025.535592:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838025.535601:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838025.535614:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838025.535638:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037082368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838025.535699:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838025.535757:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2597180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838025.536133:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037082368 00000100:00100000:1.0:1788838025.536140:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037082368 00000100:00100000:1.0:1788838025.536184:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788838025.536194:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+17:22759:x1875732037082368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838025.536206:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838025.536222:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0b79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0b72 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838025.536250:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0b72 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838025.536261:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b72 expref: 18 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838025.536271:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b400, rc 0) 00000100:00100000:1.0:1788838025.536537:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:22759:x1875732037082368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 343us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838025.536545:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788838025.536892:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037082368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838025.536919:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838025.537086:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838025.537154:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037082496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838025.537191:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838025.538353:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2597180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838025.540217:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037082496 00000100:00100000:1.0:1788838025.540233:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037082496 00000100:00100000:1.0:1788838025.540471:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788838025.540483:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:22759:x1875732037082496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838025.540682:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:22759:x1875732037082496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (3489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838025.540690:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788838025.541955:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037082496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838025.542022:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037082624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838025.542096:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838025.542143:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdf480 going to sleep for 11 seconds 00000100:00100000:1.0:1788838025.542370:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037082624 00000100:00100000:1.0:1788838025.542378:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037082624 00000100:00100000:1.0:1788838025.542428:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788838025.542437:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:22759:x1875732037082624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838025.542582:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:22759:x1875732037082624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838025.542591:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788838025.542649:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037082624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838025.543348:0:23984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788838025.543407:0:22759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788838025.543432:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788838025.543442:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838025.543452:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838026.168988:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037082752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838026.169337:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838026.170473:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037082752 00000100:00100000:0.0:1788838026.170491:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037082752 00000100:00100000:0.0:1788838026.170561:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788838026.170574:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037082752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838026.170610:0:23503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788838026.170678:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037082752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838026.170685:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788838026.170740:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037082752:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788838026.362086:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838026.681394:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838016/real 1788838016] req@ffff889affc4ca80 x1875732037076736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838026.681427:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889affc4ca80 x1875732037076736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838026.681437:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838016/real 1788838016] req@ffff8899c4ba8380 x1875732037076608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838026.681447:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8899c4ba8380 x1875732037076608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838026.681465:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad20f0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838026.681488:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788838026.681493:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037076736:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788838026.681516:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889affb25800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838026.681521:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788838026.681525:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037076608:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788838026.681672:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037082880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838026.681736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838026.681853:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037082880 00000100:00100000:3.0:1788838026.681861:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037082880 00000100:00100000:3.0:1788838026.681910:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788838026.681920:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732037082880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838026.681953:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788838026.682214:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037083008:0@lo:400:kworker.0 00000100:00100000:0.0:1788838026.682249:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838026.682285:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037083008 00000100:00100000:0.0:1788838026.682290:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037083008 00000100:00100000:0.0:1788838026.682316:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788838026.682324:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:3649:x1875732037083008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838026.682359:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:3649:x1875732037083008:12345-0@lo:400:kworker.0 Request processed in 36us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838026.682377:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788838026.682422:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037083008:0@lo:400:kworker.0 00000100:00100000:3.0:1788838026.682551:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732037082880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 632us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838026.682558:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788838026.682608:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4babb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037082880:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788838026.682671:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838026.682676:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838026.682679:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838026.682682:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788838026.682732:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037083136:0@lo:400:kworker.0 00000100:00100000:0.0:1788838026.682761:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838026.682908:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037083136 00000100:00100000:2.0:1788838026.682912:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037083136 00000100:00100000:2.0:1788838026.682949:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788838026.682957:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037083136:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788838026.683248:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838026.683253:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788838026.683256:0:38:0:(import.c:65:import_set_state_nolock()) ffff889affb25800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838026.683261:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 632 00000100:00080000:1.0:1788838026.683265:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788838026.683269:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff889affb25800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788838026.683291:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ae7ea8e00 x1875732037083264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838026.683348:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037083264:0@lo:8:kworker.0 00000400:00000100:3.0:1788838026.683372:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037083264 offset 0 length 520: 4 00000100:00080000:1.0:1788838026.683416:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838026.683420:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788838026.683422:0:38:0:(import.c:65:import_set_state_nolock()) ffff889ad20f0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838026.683425:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 632 00000100:00080000:1.0:1788838026.683427:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788838026.683431:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889ad20f0000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788838026.683444:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ae7eab480 x1875732037083392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838026.683531:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037083136:12345-0@lo:400:kworker.0 Request processed in 574us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838026.683538:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788838026.683592:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037083392:0@lo:8:kworker.0 00000400:00000100:3.0:1788838026.683612:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037083392 offset 0 length 520: 4 00010000:00080000:0.0:1788838026.683665:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889ae7eab100 x1875732037083136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838026.683675:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037083136:0@lo:400:kworker.0 00000100:00100000:3.0:1788838026.683823:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732037083520:0@lo:400:kworker.0 00000100:00100000:3.0:1788838026.683851:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838026.683915:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037083520 00000100:00100000:0.0:1788838026.683919:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037083520 00000100:00100000:0.0:1788838026.683952:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838026.683959:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732037083520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838026.686701:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732037083520:12345-0@lo:400:kworker.0 Request processed in 2734us (2841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838026.686715:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788838026.694338:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889ae7ea9500 x1875732037083520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838026.694357:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732037083520:0@lo:400:kworker.0 00000001:00100000:2.0:1788838027.196952:0:23494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788838027.386642:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838027.723756:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838012/real 1788838012] req@ffff889affc4dc00 x1875732037074688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838027 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838027.723809:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889affc4dc00 x1875732037074688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838027 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838027.723821:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838012/real 1788838012] req@ffff889affc4df80 x1875732037074816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838027 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838027.723834:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889affc4df80 x1875732037074816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838027 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838027.723874:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889aded39800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838027.723899:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788838027.723904:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037074688:0@lo:8:kworker.0 00000100:00080000:0.0:1788838027.723910:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ac4e49000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838027.723915:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788838027.723918:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037074816:0@lo:8:kworker.0 00000100:00080000:3.0:1788838027.724150:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838027.724155:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788838027.724157:0:38:0:(import.c:65:import_set_state_nolock()) ffff889aded39800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838027.724163:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 629 00000100:00080000:3.0:1788838027.724168:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788838027.724175:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff889aded39800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788838027.724194:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afc3f7480 x1875732037083904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838027.724205:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838027.724208:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788838027.724210:0:38:0:(import.c:65:import_set_state_nolock()) ffff889ac4e49000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838027.724212:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 629 00000100:00080000:3.0:1788838027.724215:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788838027.724217:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff889ac4e49000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788838027.724227:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afc3f5880 x1875732037084032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838027.724257:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838027.724260:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838027.724263:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838027.724266:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788838027.724298:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037084288:0@lo:400:kworker.0 00000100:00100000:3.0:1788838027.724360:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838027.724398:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838027.724404:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037084160:0@lo:400:kworker.0 00000100:00100000:0.0:1788838027.724419:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037083648:0@lo:400:kworker.0 00000100:00100000:3.0:1788838027.724429:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838027.724452:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838027.724491:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037084416:0@lo:400:kworker.0 00000100:00100000:0.0:1788838027.724515:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838027.724532:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838027.724537:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037083776:0@lo:400:kworker.0 00000100:00100000:0.0:1788838027.724700:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838027.724889:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037083648 00000100:00100000:0.0:1788838027.724897:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037083648 00000100:00100000:0.0:1788838027.724945:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788838027.724955:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:3648:x1875732037083648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838027.725143:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037084288 00000100:00100000:1.0:1788838027.725261:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037084288 00000100:00100000:1.0:1788838027.725289:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037083776 00000100:00100000:1.0:1788838027.725292:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037083776 00000100:00100000:1.0:1788838027.725306:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788838027.725312:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037084288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838027.725452:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788838027.725461:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037083776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838027.725706:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037084160 00000100:00100000:2.0:1788838027.725722:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037084160 00000100:00100000:2.0:1788838027.725753:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037084416 00000100:00100000:2.0:1788838027.725757:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037084416 00000100:00100000:2.0:1788838027.725772:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788838027.725795:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037084160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838027.726326:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037084288:12345-0@lo:400:kworker.0 Request processed in 1011us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838027.726336:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788838027.726442:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:3648:x1875732037083648:12345-0@lo:400:kworker.0 Request processed in 1486us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838027.726451:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788838027.726507:0:22763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788838027.726516:0:22763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788838027.726540:0:22762:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788838027.726560:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788838027.726568:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037084416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838027.726620:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037084416:12345-0@lo:400:kworker.0 Request processed in 54us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838027.726627:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788838027.726811:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037083776:12345-0@lo:400:kworker.0 Request processed in 1350us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838027.726818:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788838027.726866:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037084288:0@lo:400:kworker.0 00000100:00100000:0.0:1788838027.726973:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037083904:0@lo:8:kworker.0 00000400:00000100:0.0:1788838027.727073:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037083904 offset 0 length 520: 4 00000100:00100000:0.0:1788838027.727103:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037084032:0@lo:8:kworker.0 00000400:00000100:0.0:1788838027.727121:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037084032 offset 0 length 520: 4 00000100:00100000:1.0:1788838027.727622:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037083776:0@lo:400:kworker.0 00000100:00100000:1.0:1788838027.727833:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037083648:0@lo:400:kworker.0 00010000:00080000:1.0:1788838027.727855:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889afc3f5180 x1875732037084416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838027.727866:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037084416:0@lo:400:kworker.0 00000100:00100000:2.0:1788838027.729025:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037084160:12345-0@lo:400:kworker.0 Request processed in 3241us (4588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838027.729036:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788838027.729505:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889afc3f4000 x1875732037084160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838027.729519:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037084160:0@lo:400:kworker.0 00010000:00010000:2.0:1788838028.409088:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788838028.411488:0:23520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788838029.433086:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788838030.085732:0:24262:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788838030.085737:0:24262:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788838030.085739:0:24262:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788838030.085877:0:24262:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff889ac6b15000 00000020:01000004:0.0:1788838030.085894:0:24262:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788838030.085908:0:24262:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788838030.085922:0:24262:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff889adeb78000) 00000020:00000080:0.0:1788838030.085939:0:24262:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788838030.152429:0:24262:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788838030.153278:0:24262:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788838030.153611:0:24262:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788838030.154095:0:24262:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788838030.154338:0:24262:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788838030.154514:0:24262:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788838030.154724:0:24262:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788838030.157261:0:24262:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788838030.157507:0:24262:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788838030.157522:0:24262:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788838030.157535:0:24262:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x57f6d4e926af0b87 00000020:01000004:3.0:1788838030.157543:0:24262:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788838030.157565:0:24262:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788838030.157568:0:24262:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788838030.157582:0:24262:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788838030.157587:0:24262:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788838030.157599:0:24262:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff889ac848b370) 00000020:00000080:3.0:1788838030.157611:0:24262:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788838030.158757:0:24262:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788838030.159582:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788838030.159588:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788838030.162274:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788838030.162286:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788838030.163373:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788838030.163382:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788838030.177884:0:24262:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788838030.178122:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788838030.178134:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788838030.182585:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788838030.182606:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788838030.202193:0:24262:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788838030.202503:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788838030.202517:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788838030.211197:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788838030.211217:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788838030.213498:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788838030.213512:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788838030.215496:0:24262:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788838030.215710:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788838030.215716:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788838030.216645:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788838030.216654:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788838030.257725:0:24262:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788838030.258015:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788838030.258022:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788838030.262457:0:24262:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788838030.262473:0:24262:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788838030.263099:0:24262:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788838030.263129:0:24262:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788838030.263136:0:24262:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788838030.280398:0:24262:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788838030.280488:0:24262:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.103@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788838030.280493:0:24262:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788838030.280496:0:24262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838030.280497:0:24262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838030.280498:0:24262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838030.280500:0:24262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838030.280502:0:24262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838030.280503:0:24262:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838030.280505:0:24262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838030.280506:0:24262:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788838030.280510:0:24262:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788838030.280513:0:24262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788838030.280514:0:24262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838030.280516:0:24262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838030.280517:0:24262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838030.280518:0:24262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838030.280519:0:24262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838030.280520:0:24262:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838030.280521:0:24262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838030.280522:0:24262:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788838030.280548:0:24262:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788838030.280568:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037084544:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788838030.280771:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838030.281145:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad8689e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838030.281208:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037084544 00000100:00100000:2.0:1788838030.281217:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037084544 00000100:00100000:2.0:1788838030.281276:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788838030.281285:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:24262:x1875732037084544:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788838030.281314:0:22757:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788838030.281318:0:22757:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788838030.281322:0:22757:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788838030.281992:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:24262:x1875732037084544:12345-0@lo:253:mount.lustre.0 Request processed in 706us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838030.282002:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788838030.282092:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037084544:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788838030.282104:0:24262:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788838030.282107:0:24262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788838030.282108:0:24262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838030.282110:0:24262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838030.282111:0:24262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838030.282112:0:24262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838030.282113:0:24262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838030.282125:0:24262:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838030.282126:0:24262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838030.282128:0:24262:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788838030.282145:0:24262:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889ac6b15000 from lustre-OST0000 10000000:01000000:1.0:1788838030.282183:0:24262:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788838030.282186:0:24262:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788838030.282193:0:24262:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889af99ab370 local copy 00010000:00010000:1.0:1788838030.282205:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838030.282304:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037084672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838030.282338:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838030.282376:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad8689840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838030.282425:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037084672 00000100:00100000:2.0:1788838030.282430:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037084672 00000100:00100000:2.0:1788838030.282522:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788838030.282531:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:24262:x1875732037084672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838030.282599:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:24262:x1875732037084672:12345-0@lo:501:mount.lustre.0 Request processed in 69us (260us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788838030.282606:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788838030.282676:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037084672:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788838030.282689:0:24262:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788838030.282707:0:24262:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788838030.282714:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.282723:0:24262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838030.282744:0:24262:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889ac6b15000 10000000:01000000:1.0:1788838030.282749:0:24262:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788838030.282753:0:24262:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788838030.282756:0:24262:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788838030.282759:0:24262:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788838030.282762:0:24262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788838030.282802:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ac00/0x57f6d4e926af0b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.282834:0:24262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ac00/0x57f6d4e926af0b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.282844:0:24262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ac00/0x57f6d4e926af0b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838030.282856:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037084800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788838030.282886:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838030.283445:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad8689840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838030.283516:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037084800 00000100:00100000:3.0:1788838030.283521:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037084800 00000100:00100000:3.0:1788838030.283551:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788838030.283558:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+18:24262:x1875732037084800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838030.283567:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838030.283580:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c2229000/0x57f6d4e926af0b9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0b95 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.283604:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2229000/0x57f6d4e926af0b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0b95 expref: 19 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.283613:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c2229000/0x57f6d4e926af0b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b95 expref: 19 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.283621:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2229000, rc 0) 00000100:00100000:3.0:1788838030.283843:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:24262:x1875732037084800:12345-0@lo:101:mount.lustre.0 Request processed in 285us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838030.283850:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788838030.284053:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037084800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838030.284068:0:24262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ac00/0x57f6d4e926af0b95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b9c expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.284078:0:24262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ac00/0x57f6d4e926af0b95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0b9c expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788838030.285145:0:24262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788838030.285913:0:24262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838030.288462:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788838030.288524:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788838030.288542:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788838030.288557:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788838030.288572:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788838030.288587:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788838030.288603:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788838030.288618:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788838030.288726:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788838030.289237:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788838030.289264:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788838030.289284:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788838030.289312:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788838030.289318:0:24262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788838030.289424:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037084928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838030.289507:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838030.289739:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad08250c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838030.291260:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037084928 00000100:00100000:3.0:1788838030.291274:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037084928 00000100:00100000:3.0:1788838030.291373:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788838030.291383:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:24262:x1875732037084928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838030.291581:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:24262:x1875732037084928:12345-0@lo:501:mount.lustre.0 Request processed in 199us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838030.291602:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788838030.291695:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037084928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838030.291757:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838030.291838:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838030.292225:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac9699840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838030.292281:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037085056 00000100:00100000:2.0:1788838030.292293:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037085056 00000100:00100000:2.0:1788838030.292322:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788838030.292330:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:24262:x1875732037085056:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838030.293172:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:24262:x1875732037085056:12345-0@lo:503:mount.lustre.0 Request processed in 839us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838030.293182:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788838030.293377:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085056:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788838030.294130:0:24262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788838030.294233:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838030.294285:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838030.294382:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac9699840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838030.294498:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037085184 00000100:00100000:1.0:1788838030.294512:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037085184 00000100:00100000:2.0:1788838030.294566:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788838030.294578:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:24262:x1875732037085184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838030.295269:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:24262:x1875732037085184:12345-0@lo:502:mount.lustre.0 Request processed in 691us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838030.295278:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788838030.295383:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838030.295606:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788838030.295633:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788838030.295659:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788838030.295791:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788838030.295807:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788838030.295841:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788838030.295972:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788838030.295991:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788838030.296002:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788838030.296013:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788838030.296023:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788838030.296034:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788838030.296061:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838030.296102:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838030.296130:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac9699840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838030.296197:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037085312 00000100:00100000:3.0:1788838030.296203:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037085312 00000100:00100000:3.0:1788838030.296244:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788838030.296251:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:24262:x1875732037085312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838030.296342:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:24262:x1875732037085312:12345-0@lo:502:mount.lustre.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838030.296349:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788838030.296465:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838030.296502:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788838030.296510:0:24262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788838030.300505:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788838030.300517:0:24280:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788838030.300524:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838030.300526:0:24280:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788838030.300532:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838030.300547:0:24280:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff889adeb799b8) 00000020:00000080:0.0:1788838030.300572:0:24280:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788838030.300578:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788838030.300929:0:24280:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ac6b15000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788838030.300938:0:24280:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788838030.300945:0:24280:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x57f6d4e926af0baa 00010000:00010000:0.0:1788838030.309565:0:24280:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788838030.310475:0:24280:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1788838030.312200:0:24280:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788838030.320045:0:24280:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788838030.320060:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838030.320068:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838030.320070:0:24280:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788838030.320074:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838030.320082:0:24280:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788838030.320083:0:24280:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838030.320085:0:24280:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838030.320087:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838030.320090:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838030.320091:0:24280:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838030.320094:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838030.320097:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838030.320098:0:24280:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788838030.320101:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788838030.320103:0:24280:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788838030.320105:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838030.320107:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838030.320109:0:24280:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788838030.320111:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838030.320113:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838030.320114:0:24280:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788838030.320117:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788838030.320150:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838030.320153:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838030.320155:0:24280:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788838030.320158:0:24280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788838030.332011:0:24262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788838030.332062:0:24262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788838030.332091:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ac00/0x57f6d4e926af0b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b9c expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.332105:0:24262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ac00/0x57f6d4e926af0b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0b9c expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838030.332114:0:24262:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac6b15000 from 1 10000000:01000000:3.0:1788838030.332116:0:24262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838030.332152:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.332161:0:24262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.332172:0:24262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838030.332197:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838030.332279:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838030.332323:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2597c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838030.332413:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037085440 00000100:00100000:0.0:1788838030.332421:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037085440 00000100:00100000:0.0:1788838030.332476:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788838030.332486:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:24262:x1875732037085440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838030.332501:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838030.332515:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926af0bb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0bb1 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.332539:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926af0bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0bb1 expref: 20 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.332550:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926af0bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0bb1 expref: 20 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.332567:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16e00, rc 0) 00000100:00100000:0.0:1788838030.332605:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:24262:x1875732037085440:12345-0@lo:101:mount.lustre.0 Request processed in 120us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.332611:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788838030.332832:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838030.332847:0:24262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.332857:0:24262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788838030.336817:0:24262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788838030.337340:0:24262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838030.337565:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788838030.337591:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788838030.337606:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788838030.337619:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788838030.337632:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788838030.341300:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788838030.341333:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788838030.341347:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788838030.341360:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788838030.341372:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788838030.341384:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788838030.341406:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788838030.341411:0:24262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788838030.341519:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838030.341580:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838030.341626:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded0b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788838030.341773:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037085568 00000100:00100000:0.0:1788838030.341817:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037085568 00000100:00100000:0.0:1788838030.341870:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788838030.341880:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889acadd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:24262:x1875732037085568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838030.341995:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889acadd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:24262:x1875732037085568:12345-0@lo:501:mount.lustre.0 Request processed in 117us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.342004:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788838030.342512:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838030.342548:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085696:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838030.342602:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838030.342673:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded0b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788838030.345198:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037085696 00000100:00100000:0.0:1788838030.345216:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037085696 00000100:00100000:0.0:1788838030.345272:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788838030.345283:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889acaddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:24262:x1875732037085696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838030.345460:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889acaddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:24262:x1875732037085696:12345-0@lo:503:mount.lustre.0 Request processed in 179us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.345468:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788838030.345575:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085696:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788838030.346221:0:24262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788838030.346321:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838030.346371:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838030.346412:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad080ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838030.346632:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037085824 00000100:00100000:3.0:1788838030.346638:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037085824 00000100:00100000:3.0:1788838030.346687:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788838030.346697:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889acadda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:24262:x1875732037085824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838030.346833:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889acadda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:24262:x1875732037085824:12345-0@lo:502:mount.lustre.0 Request processed in 137us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838030.346841:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788838030.347468:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788838030.347697:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788838030.347727:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788838030.347741:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788838030.347753:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788838030.347767:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788838030.348004:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788838030.348022:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788838030.348035:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788838030.348047:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788838030.348060:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788838030.348086:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788838030.348115:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838030.348161:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838030.348201:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad080ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838030.348288:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037085952 00000100:00100000:3.0:1788838030.348294:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037085952 00000100:00100000:3.0:1788838030.348335:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788838030.348343:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac33df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:24262:x1875732037085952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838030.348447:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac33df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:24262:x1875732037085952:12345-0@lo:502:mount.lustre.0 Request processed in 104us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838030.348455:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788838030.348569:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037085952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788838030.348607:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788838030.348614:0:24262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788838030.352900:0:24284:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838030.352914:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838030.352917:0:24284:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788838030.352925:0:24284:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ac6b15000 00000020:00000080:1.0:1788838030.352928:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788838030.352935:0:24284:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838030.352938:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838030.352939:0:24284:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788838030.352942:0:24284:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838030.352944:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838030.352945:0:24284:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788838030.352948:0:24284:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ac6b15000 00000020:00000080:1.0:1788838030.352950:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788838030.353019:0:24284:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838030.353023:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838030.353024:0:24284:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788838030.353027:0:24284:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838030.353029:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838030.353030:0:24284:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788838030.353033:0:24284:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ac6b15000 00000020:00000080:1.0:1788838030.353035:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788838030.353053:0:24284:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838030.353055:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838030.353057:0:24284:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788838030.353059:0:24284:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838030.353061:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838030.353063:0:24284:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788838030.353066:0:24284:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ac6b15000 00000020:00000080:1.0:1788838030.353068:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788838030.353088:0:24284:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838030.353092:0:24284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838030.353093:0:24284:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788838030.353097:0:24284:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788838030.353179:0:24262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788838030.353212:0:24262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788838030.353234:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.353247:0:24262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838030.353289:0:24262:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788838030.353292:0:24262:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889ac6b15000 10000000:01000000:1.0:1788838030.353295:0:24262:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889ac6b15000 10000000:01000000:1.0:1788838030.353299:0:24262:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788838030.353305:0:24262:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ac6b15000 from 1 10000000:01000000:1.0:1788838030.353308:0:24262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838030.353343:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af0bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.353352:0:24262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af0bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.353363:0:24262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af0bbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838030.353385:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788838030.353460:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838030.353497:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad8689540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838030.353728:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037086080 00000100:00100000:0.0:1788838030.353736:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037086080 00000100:00100000:0.0:1788838030.353804:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788838030.353824:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac33dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:24262:x1875732037086080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838030.353836:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838030.353850:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b16200/0x57f6d4e926af0bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0bbf expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.353887:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b16200/0x57f6d4e926af0bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0bbf expref: 21 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.353898:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b16200/0x57f6d4e926af0bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0bbf expref: 21 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.353907:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16200, rc 0) 00000100:00100000:0.0:1788838030.353948:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac33dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037086080:12345-0@lo:101:mount.lustre.0 Request processed in 126us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.353955:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788838030.354219:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838030.354234:0:24262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af0bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0bc6 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.354255:0:24262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af0bbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0bc6 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788838030.360313:0:24262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788838030.360614:0:24262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788838030.360890:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788838030.360913:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788838030.360925:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788838030.360938:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788838030.360949:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788838030.361172:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788838030.361193:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788838030.361208:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788838030.361222:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788838030.361235:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788838030.361249:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788838030.361264:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788838030.361276:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788838030.361289:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788838030.361300:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788838030.361312:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788838030.361339:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788838030.361357:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788838030.361372:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788838030.361386:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788838030.361400:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788838030.361413:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788838030.361447:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788838030.361463:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788838030.361479:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788838030.361493:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788838030.361507:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788838030.361521:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788838030.361535:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788838030.361549:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788838030.361562:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788838030.361575:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788838030.361603:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788838030.361620:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788838030.361634:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788838030.361718:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788838030.361733:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788838030.361748:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788838030.361762:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788838030.361805:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788838030.361824:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788838030.361838:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788838030.361852:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788838030.361866:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788838030.361880:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788838030.361895:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788838030.361910:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788838030.361924:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788838030.362275:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788838030.362298:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788838030.362316:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788838030.362321:0:24262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788838030.362417:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838030.362501:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838030.362558:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad080ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838030.363886:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037086208 00000100:00100000:0.0:1788838030.363898:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037086208 00000100:00100000:0.0:1788838030.363957:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788838030.363968:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac33dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037086208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838030.364138:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac33dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037086208:12345-0@lo:501:mount.lustre.0 Request processed in 171us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.364146:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788838030.364196:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838030.364240:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086336:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838030.364287:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838030.364324:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad080ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838030.366821:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037086336 00000100:00100000:0.0:1788838030.366838:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037086336 00000100:00100000:0.0:1788838030.366912:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788838030.366924:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037086336:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838030.367090:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037086336:12345-0@lo:503:mount.lustre.0 Request processed in 167us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.367098:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788838030.367162:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086336:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788838030.367634:0:24262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788838030.367730:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838030.367790:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838030.367817:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037086464 00000100:00100000:0.0:1788838030.367821:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037086464 00000100:00100000:0.0:1788838030.367858:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788838030.367865:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037086464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838030.367942:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037086464:12345-0@lo:502:mount.lustre.0 Request processed in 77us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.367950:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788838030.367990:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7e99f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838030.368004:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838030.368179:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788838030.368207:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788838030.368221:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788838030.368235:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788838030.368247:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788838030.368260:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788838030.368274:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788838030.368287:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788838030.368299:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788838030.368329:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788838030.368345:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788838030.368357:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788838030.368370:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788838030.368381:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788838030.368391:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788838030.368401:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788838030.368425:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788838030.368451:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788838030.368465:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788838030.368476:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788838030.368487:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788838030.368499:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788838030.368510:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788838030.368524:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788838030.368537:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788838030.368564:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788838030.368580:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788838030.368593:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788838030.368605:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788838030.368617:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788838030.368630:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788838030.368645:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788838030.368658:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788838030.368671:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788838030.368683:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788838030.368696:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788838030.368711:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788838030.368725:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788838030.368738:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788838030.368757:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788838030.368772:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788838030.368825:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788838030.368841:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788838030.368855:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788838030.368867:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788838030.368880:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788838030.368892:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788838030.368905:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788838030.368940:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838030.368991:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838030.369024:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7e99f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838030.369063:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037086592 00000100:00100000:2.0:1788838030.369069:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037086592 00000100:00100000:2.0:1788838030.369118:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788838030.369126:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037086592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838030.369220:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037086592:12345-0@lo:502:mount.lustre.0 Request processed in 95us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838030.369227:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788838030.375305:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838030.375560:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788838030.375588:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788838030.375624:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838030.375705:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838030.375749:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7e99f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838030.377062:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037086720 00000100:00100000:3.0:1788838030.377073:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037086720 00000100:00100000:3.0:1788838030.377125:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788838030.377134:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037086720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838030.377277:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037086720:12345-0@lo:502:mount.lustre.0 Request processed in 144us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838030.377287:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788838030.377464:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4ba8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037086720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788838030.377527:0:24262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788838030.377538:0:24262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788838030.382908:0:24289:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788838030.382926:0:24289:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff889ac84899b8) 00000020:00000080:3.0:1788838030.382951:0:24289:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788838030.383024:0:24289:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ac6b15000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788838030.383036:0:24289:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ac6b15000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788838030.383038:0:24289:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac6b15000 3 00010000:00080000:3.0:1788838030.383068:0:24289:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889aff1af000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788838030.386403:0:24289:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788838030.387143:0:24289:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788838030.387211:0:24289:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788838030.387225:0:24289:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x57f6d4e926af0bd4 00000100:00080000:1.0:1788838030.387237:0:24289:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788838030.387242:0:24289:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff889aff1af000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788838030.387280:0:24289:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ae7ea8a80 x1875732037086848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838030.387309:0:24289:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788838030.389071:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037086848:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838030.389150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838030.389292:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838030.389296:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838030.389299:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838030.389302:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838030.389333:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838030.389336:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838030.389339:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838030.389342:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788838030.389423:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037087104:0@lo:400:kworker.0 00000100:00100000:3.0:1788838030.389485:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037087360:0@lo:400:kworker.0 00000100:00100000:0.0:1788838030.389931:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037086976:0@lo:400:kworker.0 00000100:00100000:0.0:1788838030.389963:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838030.389996:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037087232:0@lo:400:kworker.0 00000100:00100000:0.0:1788838030.390021:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838030.390047:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838030.398031:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037086976 00000100:00100000:0.0:1788838030.398046:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037086976 00000100:00100000:0.0:1788838030.398088:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037087232 00000100:00100000:0.0:1788838030.398091:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037087232 00000100:00100000:0.0:1788838030.398110:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788838030.398119:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037086976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838030.398202:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037086976:12345-0@lo:400:kworker.0 Request processed in 84us (8237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.398221:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788838030.398240:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788838030.398246:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037087232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838030.398284:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037087232:12345-0@lo:400:kworker.0 Request processed in 38us (8262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.398290:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788838030.398372:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838030.398390:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037086848 00000100:00100000:1.0:1788838030.398395:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037086848 00000100:00100000:1.0:1788838030.398415:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037087360 00000100:00100000:1.0:1788838030.398418:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037087360 00000100:00100000:1.0:1788838030.398456:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788838030.398463:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037087360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838030.398502:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037087360:12345-0@lo:400:kworker.0 Request processed in 40us (8454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838030.398508:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788838030.398521:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788838030.398525:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875732037086848:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788838030.398546:0:22762:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:1.0:1788838030.398590:0:22762:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x57f6d4e926af0bdb 00000004:00100000:1.0:1788838030.398605:0:22762:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788838030.398634:0:22762:0:(import.c:65:import_set_state_nolock()) ffff8899c3df8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838030.400878:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875732037086848:12345-0@lo:38:llog_process_th.0 Request processed in 2330us (11707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838030.400890:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1788838030.401018:0:24289:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788838030.401034:0:24289:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8899c22cb370) 00000020:00000080:1.0:1788838030.401062:0:24289:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788838030.401146:0:24289:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ac6b15000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788838030.401151:0:24289:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ac6b15000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788838030.401153:0:24289:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac6b15000 3 00010000:00080000:1.0:1788838030.401182:0:24289:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c3dfb800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.103@tcp at head 00000100:00100000:0.0:1788838030.403065:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037086976:0@lo:400:kworker.0 00000100:00100000:0.0:1788838030.403110:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037087232:0@lo:400:kworker.0 00010000:00080000:0.0:1788838030.403146:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889ae7ea8a80 x1875732037086848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838030.403157:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838030.403164:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788838030.403173:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788838030.403178:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788838030.403182:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889aff1af000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788838030.403189:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037086848:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788838030.403221:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889afc3f5c00 x1875732037087360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838030.403231:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037087360:0@lo:400:kworker.0 00000100:00100000:3.0:1788838030.405182:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037087104 00000100:00100000:3.0:1788838030.405195:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037087104 00000100:00100000:3.0:1788838030.405246:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788838030.405256:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037087104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838030.405333:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037087104:12345-0@lo:400:kworker.0 Request processed in 78us (6961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838030.405341:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788838030.405380:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889afc3f7800 x1875732037087104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838030.405393:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037087104:0@lo:400:kworker.0 00010000:00010000:2.0:1788838030.408290:0:24289:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788838030.411062:0:24289:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788838030.411170:0:24289:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788838030.411184:0:24289:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x57f6d4e926af0be9 00000100:00080000:2.0:1788838030.411195:0:24289:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788838030.411201:0:24289:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8899c3dfb800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788838030.411236:0:24289:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889affc4f480 x1875732037087488/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838030.411266:0:24289:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788838030.411763:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875732037087488:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788838030.411869:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838030.412049:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838030.412055:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838030.412058:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838030.412061:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838030.412065:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838030.412068:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838030.412070:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788838030.412073:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788838030.413345:0:24289:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788838030.413502:0:24262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788838030.413533:0:24262:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838030.413554:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af0bbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0bc6 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.413565:0:24262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af0bbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0bc6 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788838030.413612:0:24262:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788838030.413614:0:24262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838030.413616:0:24262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838030.413617:0:24262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838030.413619:0:24262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838030.413620:0:24262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838030.413622:0:24262:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838030.413623:0:24262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838030.413624:0:24262:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788838030.413628:0:24262:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788838030.413630:0:24262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788838030.413632:0:24262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838030.413636:0:24262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838030.413637:0:24262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838030.413638:0:24262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838030.413639:0:24262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838030.413640:0:24262:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838030.413641:0:24262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838030.413642:0:24262:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788838030.413730:0:24262:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788838030.413750:0:24262:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037087616:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788838030.415025:0:24262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838030.415073:0:24262:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad8689e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838030.415355:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037087616 00000100:00100000:0.0:1788838030.415363:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037087616 00000100:00100000:0.0:1788838030.415454:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788838030.415464:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037087616:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788838030.415502:0:22756:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788838030.415516:0:22756:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788838030.415768:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037087488 00000100:00100000:2.0:1788838030.415774:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037087488 00000100:00100000:2.0:1788838030.415817:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788838030.415823:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875732037087488:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788838030.415852:0:22763:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:2.0:1788838030.417764:0:22763:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x57f6d4e926af0bf0 00000004:00100000:2.0:1788838030.417798:0:22763:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788838030.417837:0:22763:0:(import.c:65:import_set_state_nolock()) ffff889afca65000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838030.418032:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875732037087488:12345-0@lo:38:llog_process_th.0 Request processed in 2206us (6161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838030.418043:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788838030.418487:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889affc4f480 x1875732037087488/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838030.418499:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788838030.418509:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788838030.418516:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788838030.418521:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788838030.418524:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c3dfb800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788838030.418530:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875732037087488:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788838030.422043:0:22756:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788838030.422064:0:22756:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788838030.422202:0:22778:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788838030.422208:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788838030.422230:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.422249:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926af0b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b3a expref: 21 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.422258:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0b4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b48 expref: 21 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.422265:0:22778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.422301:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0b48 expref: 21 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.422314:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0b4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0b48 expref: 21 pid: 22757 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838030.422335:0:22778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037087744:0@lo:104: 00000100:00100000:3.0:1788838030.422399:0:22778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838030.422612:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:24262:x1875732037087616:12345-0@lo:253:mount.lustre.0 Request processed in 7149us (7590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838030.422623:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788838030.422705:0:24262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:24262:1875732037087616:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788838030.422718:0:24262:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788838030.422721:0:24262:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788838030.422723:0:24262:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838030.422724:0:24262:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838030.422726:0:24262:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838030.422727:0:24262:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838030.422728:0:24262:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838030.422730:0:24262:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838030.422731:0:24262:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838030.422733:0:24262:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788838030.422747:0:24262:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788838030.423564:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926af0b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0b3a expref: 20 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838030.423576:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926af0b41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0b3a expref: 20 pid: 22757 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838030.423587:0:22778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037087872:0@lo:104: 00000100:00100000:3.0:1788838030.423620:0:22778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838030.424056:0:22778:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c33d8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838030.424097:0:22745:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788838030.424112:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037087744 00000100:00100000:0.0:1788838030.424118:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037087744 00000100:00100000:0.0:1788838030.424148:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037087872 00000100:00100000:0.0:1788838030.424152:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037087872 00000100:00100000:0.0:1788838030.424165:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838030.424173:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+4:22778:x1875732037087744:12345-0@lo:104: 00010000:00010000:0.0:1788838030.424185:0:22745:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.424251:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788838030.424257:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+4:22778:x1875732037087744:12345-0@lo:104: Request processed in 85us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.424263:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838030.424278:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838030.424284:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af7626450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:22778:x1875732037087872:12345-0@lo:104: 00010000:00010000:0.0:1788838030.424292:0:22745:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.424323:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788838030.424328:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af7626450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:22778:x1875732037087872:12345-0@lo:104: Request processed in 45us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.424334:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788838030.424369:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838030.424374:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838030.426559:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788838030.428870:0:22778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037087744:0@lo:104: 00000100:00100000:1.0:1788838030.428890:0:22778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037087872:0@lo:104: 00010000:00010000:1.0:1788838030.428916:0:22778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.429024:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838030.429033:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.429041:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229400 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788838030.429045:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.429055:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838030.429062:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838030.429068:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838030.429117:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.429124:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838030.429142:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.429150:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c2229400/0x57f6d4e926af0b3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b41 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838030.429163:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838030.429165:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838030.429167:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838030.429171:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838030.429179:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838030.429429:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2228400 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788838030.429442:0:22750:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.429449:0:22750:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838030.429455:0:22750:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838030.429461:0:22750:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1788838030.429484:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037088000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838030.429544:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838030.429617:0:22750:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.429624:0:22750:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838030.429752:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.429760:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c2228400/0x57f6d4e926af0b48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b4f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838030.429795:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838030.429804:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037088128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838030.429926:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838030.429961:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037088000 00000100:00100000:0.0:1788838030.429966:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037088000 00010000:00010000:0.0:1788838030.429998:0:22747:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926af0b41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0b3a expref: 21 pid: 22757 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838030.430022:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037088128 00000100:00100000:0.0:1788838030.430024:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037088128 00010000:00010000:0.0:1788838030.430035:0:22747:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0b4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0b48 expref: 22 pid: 22757 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838030.430048:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838030.430055:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:3649:x1875732037088000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838030.430068:0:22747:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838030.430073:0:22747:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926af0b41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0b3a expref: 22 pid: 22757 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430082:0:22747:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926af0b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0b3a expref: 22 pid: 22757 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430098:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926af0b41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0b3a expref: 22 pid: 22757 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430110:0:22747:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838030.430141:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:3649:x1875732037088000:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.430147:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838030.430163:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838030.430169:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:3651:x1875732037088128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838030.430175:0:22747:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838030.430179:0:22747:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0b4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0b48 expref: 20 pid: 22757 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430198:0:22747:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0b48 expref: 20 pid: 22757 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430207:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0b4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0b48 expref: 20 pid: 22757 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430218:0:22747:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430226:0:22747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788838030.430241:0:22747:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008033639s 00010000:00010000:0.0:1788838030.430245:0:22747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430253:0:22747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430260:0:22747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430266:0:22747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430272:0:22747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2228200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838030.430276:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430282:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430306:0:22747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430315:0:22747:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838030.430342:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:3651:x1875732037088128:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838030.430349:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838030.430404:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037088000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838030.430420:0:22778:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430427:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838030.430443:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0bf7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838030.430465:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037088128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838030.430476:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838030.430478:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838030.430480:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838030.430793:0:22746:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000001:00000004:1.0:1788838030.432299:0:24262:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788838030.441325:0:24262:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788838030.441334:0:24262:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788838030.441367:0:24262:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788838030.441400:0:24262:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788838030.441418:0:24262:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788838030.441442:0:24262:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788838030.442254:0:24262:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838030.442463:0:24262:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788838030.468071:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788838031.285216:0:24344:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838031.285589:0:24344:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788838031.297414:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037088256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838031.297509:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838031.297574:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037088256 00000100:00100000:0.0:1788838031.297581:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037088256 00000100:00100000:0.0:1788838031.297643:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788838031.297652:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037088256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838031.297702:0:22767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788838031.297751:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037088256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838031.297758:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788838031.297823:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037088256:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788838031.483822:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838031.803579:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838031.803616:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037088384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838031.803685:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838031.803745:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037088384 00000100:00100000:3.0:1788838031.803753:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037088384 00000100:00100000:3.0:1788838031.803824:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788838031.803834:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037088384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838031.803882:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788838031.803933:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037088384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838031.803943:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788838031.803991:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037088384:0@lo:41:osp-pre-1-0.0 10000000:01000000:0.0:1788838032.441065:0:22759:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788838032.441072:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8899c277b800 from 13 10000000:01000000:0.0:1788838032.441076:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788838032.441120:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838032.441129:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838032.441137:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838032.441160:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037088512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838032.441231:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838032.441265:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838032.441318:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037088512 00000100:00100000:1.0:1788838032.441327:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037088512 00000100:00100000:1.0:1788838032.441383:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788838032.441392:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+19:22759:x1875732037088512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838032.441415:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838032.441429:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9be00/0x57f6d4e926af0c05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0bfe expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838032.441453:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9be00/0x57f6d4e926af0c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0bfe expref: 20 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838032.441462:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9be00/0x57f6d4e926af0c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0bfe expref: 20 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838032.441469:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9be00, rc 0) 00000100:00100000:1.0:1788838032.441507:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:22759:x1875732037088512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838032.441526:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788838032.441638:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037088512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838032.441654:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838032.441663:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838032.441701:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037088640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788838032.441727:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838032.441743:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838032.443534:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037088640 00000100:00100000:1.0:1788838032.443547:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037088640 00000100:00100000:1.0:1788838032.443603:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788838032.443613:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:22759:x1875732037088640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788838032.443635:0:22756:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788838032.443659:0:22756:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788838032.443661:0:22756:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788838032.443758:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:22759:x1875732037088640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838032.443763:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788838032.443912:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037088640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788838032.443979:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788838032.443987:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838032.443994:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838032.444000:0:22759:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788838032.444002:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8899c30c6000 from 13 10000000:01000000:0.0:1788838032.444003:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788838032.444025:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838032.444030:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838032.444036:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838032.444049:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037088768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838032.444070:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838032.444098:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838032.444140:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037088768 00000100:00100000:3.0:1788838032.444143:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037088768 00000100:00100000:3.0:1788838032.444176:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788838032.444180:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:22759:x1875732037088768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838032.444186:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838032.444196:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0c0c expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838032.444221:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0c0c expref: 21 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838032.444229:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0c0c expref: 21 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838032.444235:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2228c00, rc 0) 00000100:00100000:3.0:1788838032.444263:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:22759:x1875732037088768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838032.444270:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788838032.444499:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037088768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838032.444508:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838032.444522:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838032.444549:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037088896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788838032.444570:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838032.444586:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838032.444630:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037088896 00000100:00100000:3.0:1788838032.444634:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037088896 00000100:00100000:3.0:1788838032.444651:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788838032.444657:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:22759:x1875732037088896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788838032.444667:0:22757:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788838032.444677:0:22757:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788838032.444678:0:22757:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788838032.444735:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:22759:x1875732037088896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 78us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838032.444740:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788838032.444835:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037088896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788838032.444867:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788838032.444872:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838032.444877:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838032.506380:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838033.531195:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838034.554028:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788838035.001521:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788838035.583920:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788838035.897164:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838035.897170:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838035.897173:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838035.897176:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838035.897191:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838035.897194:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838035.897196:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838035.897199:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788838035.897242:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037089408:0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.897329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838035.897379:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788838035.897385:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037089024:0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.897416:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838035.897443:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037089536:0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.897465:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838035.897488:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037089152:0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.897510:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838035.897525:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037089664:0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.897546:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838035.897563:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788838035.897568:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037089280:0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.897586:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838035.897600:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037089792:0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.897617:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838035.897651:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037089408 00000100:00100000:1.0:1788838035.897657:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037089408 00000100:00100000:1.0:1788838035.897696:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037089152 00000100:00100000:1.0:1788838035.897699:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037089152 00000100:00100000:1.0:1788838035.897715:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788838035.897723:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037089408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.897796:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037089408:12345-0@lo:400:kworker.0 Request processed in 53us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838035.897804:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788838035.897822:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788838035.897829:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037089152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.897870:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037089152:12345-0@lo:400:kworker.0 Request processed in 41us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838035.897876:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788838035.897894:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037089024 00000100:00100000:1.0:1788838035.897897:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037089024 00000100:00100000:1.0:1788838035.897923:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788838035.897929:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:3648:x1875732037089024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.897958:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:3648:x1875732037089024:12345-0@lo:400:kworker.0 Request processed in 30us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838035.897964:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788838035.898003:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037089536 00000100:00100000:1.0:1788838035.898008:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037089536 00000100:00100000:1.0:1788838035.898027:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037089664 00000100:00100000:1.0:1788838035.898029:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037089664 00000100:00100000:1.0:1788838035.898047:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037089280 00000100:00100000:1.0:1788838035.898050:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037089280 00000100:00100000:1.0:1788838035.898060:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037089792 00000100:00100000:1.0:1788838035.898061:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037089792 00000100:00100000:1.0:1788838035.898079:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788838035.898085:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037089536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.898115:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037089536:12345-0@lo:400:kworker.0 Request processed in 31us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838035.898121:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788838035.898132:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788838035.898138:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037089664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.898162:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037089664:12345-0@lo:400:kworker.0 Request processed in 25us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838035.898176:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788838035.898187:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788838035.898192:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037089280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.898218:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037089280:12345-0@lo:400:kworker.0 Request processed in 25us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838035.898223:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788838035.898234:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788838035.898240:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037089792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.898264:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037089792:12345-0@lo:400:kworker.0 Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838035.898270:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788838035.898317:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7eaad80 x1875732037089280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838035.898331:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037089280:0@lo:400:kworker.0 00010000:00080000:1.0:1788838035.898353:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7eaaa00 x1875732037089792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838035.898362:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037089792:0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.898372:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037089152:0@lo:400:kworker.0 00010000:00080000:1.0:1788838035.898379:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7ea9c00 x1875732037089664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838035.898387:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037089664:0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.898415:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037089024:0@lo:400:kworker.0 00010000:00080000:1.0:1788838035.898433:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7ea8380 x1875732037089536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838035.898441:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037089536:0@lo:400:kworker.0 00000100:00100000:1.0:1788838035.898449:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037089408:0@lo:400:kworker.0 00000100:00080000:2.0:1788838035.900467:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838035.900476:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838036.408937:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838036.408964:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037089920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838036.409050:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838036.409109:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037089920 00000100:00100000:0.0:1788838036.409117:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037089920 00000100:00100000:0.0:1788838036.409173:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788838036.409195:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037089920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838036.409233:0:23503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788838036.409280:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037089920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838036.409288:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788838036.409804:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037089920:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788838036.604968:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838036.920885:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838036.920910:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037090048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838036.920999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838036.921021:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037090048 00000100:00100000:1.0:1788838036.921029:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037090048 00000100:00100000:1.0:1788838036.921090:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788838036.921100:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037090048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838036.921133:0:22767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788838036.921189:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037090048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838036.921196:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788838036.921372:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037090048:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788838036.955839:0:24634:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788838037.626368:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788838037.923595:0:24687:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788838037.924032:0:24687:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788838038.650580:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788838038.654275:0:23520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788838038.856136:0:24737:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788838038.856364:0:24737:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788838039.673307:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838040.697203:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838041.019674:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037090176:0@lo:400:kworker.0 00000100:00100000:1.0:1788838041.019748:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838041.019919:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037090176 00000100:00100000:0.0:1788838041.019927:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037090176 00000100:00100000:0.0:1788838041.019977:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788838041.019986:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:3650:x1875732037090176:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788838041.022574:0:19332:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838041.022584:0:19332:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788838041.022587:0:19332:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838041.022590:0:19332:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788838041.022647:0:19332:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838041.022651:0:19332:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788838041.022653:0:19332:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788838041.022656:0:19332:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788838041.022705:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037090304:0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.022770:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838041.022821:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732037090816:0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.022849:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838041.022872:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838041.022878:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732037090688:0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.025617:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838041.025694:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037090432:0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.025746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838041.025765:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037090944:0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.025803:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838041.025826:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838041.025833:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037090560:0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.025858:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838041.025893:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037090304 00000100:00100000:2.0:1788838041.025915:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037090304 00000100:00100000:2.0:1788838041.025961:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037090560 00000100:00100000:2.0:1788838041.025965:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037090560 00000100:00100000:2.0:1788838041.025984:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788838041.025992:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037090304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.026050:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037090304:12345-0@lo:400:kworker.0 Request processed in 58us (3279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838041.026063:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788838041.026083:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788838041.026090:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037090560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.026125:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037090560:12345-0@lo:400:kworker.0 Request processed in 36us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838041.026131:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788838041.026150:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037090816 00000100:00100000:2.0:1788838041.026154:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037090816 00000100:00100000:2.0:1788838041.026182:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037090688 00000100:00100000:2.0:1788838041.026186:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037090688 00000100:00100000:2.0:1788838041.026195:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037090432 00000100:00100000:2.0:1788838041.026197:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037090432 00000100:00100000:2.0:1788838041.026205:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037090944 00000100:00100000:2.0:1788838041.026207:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037090944 00000100:00100000:2.0:1788838041.026220:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788838041.026226:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732037090816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.026270:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732037090816:12345-0@lo:400:kworker.0 Request processed in 44us (3419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838041.026276:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788838041.026289:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788838041.026294:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732037090688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.026322:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732037090688:12345-0@lo:400:kworker.0 Request processed in 28us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838041.026328:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788838041.026340:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788838041.026345:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037090432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.026380:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037090432:12345-0@lo:400:kworker.0 Request processed in 35us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838041.026386:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788838041.026398:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788838041.026404:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037090944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.026430:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037090944:12345-0@lo:400:kworker.0 Request processed in 27us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838041.026436:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788838041.026481:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838041.026485:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838041.026512:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037090560:0@lo:400:kworker.0 00010000:00080000:2.0:1788838041.026526:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889affc4e300 x1875732037090432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838041.026535:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037090432:0@lo:400:kworker.0 00010000:00080000:2.0:1788838041.026544:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889affc4df80 x1875732037090944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838041.026551:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037090944:0@lo:400:kworker.0 00010000:00080000:2.0:1788838041.026581:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889affc4e680 x1875732037090688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838041.026589:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732037090688:0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.026599:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037090304:0@lo:400:kworker.0 00010000:00080000:2.0:1788838041.026608:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889affc4d880 x1875732037090816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838041.026627:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732037090816:0@lo:400:kworker.0 00000100:00100000:0.0:1788838041.027208:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:3650:x1875732037090176:12345-0@lo:400:kworker.0 Request processed in 7220us (7457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838041.027217:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788838041.027319:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037090176:0@lo:400:kworker.0 00000100:00100000:0.0:1788838041.534102:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838041.534131:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037091072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838041.534206:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838041.540043:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037091072 00000100:00100000:0.0:1788838041.540057:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037091072 00000100:00100000:0.0:1788838041.540119:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788838041.540128:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037091072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838041.540164:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788838041.540276:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037091072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (6070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838041.540283:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788838041.540333:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037091072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838041.657271:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838026/real 1788838026] req@ffff889ae7eab480 x1875732037083392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838041 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838041.657306:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889ae7eab480 x1875732037083392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838041 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838041.657316:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838026/real 1788838026] req@ffff889ae7ea8e00 x1875732037083264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838041 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838041.657325:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889ae7ea8e00 x1875732037083264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838041 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838041.657342:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad20f0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838041.657364:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788838041.657368:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037083392:0@lo:8:kworker.0 00000100:00080000:2.0:1788838041.657374:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889affb25800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838041.657379:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788838041.657382:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037083264:0@lo:8:kworker.0 00000100:00080000:1.0:1788838041.657497:0:19332:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838041.657501:0:19332:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838041.657504:0:19332:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838041.657506:0:19332:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838041.657525:0:19332:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838041.657528:0:19332:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788838041.657538:0:19332:0:(import.c:65:import_set_state_nolock()) ffff889affb25800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838041.657542:0:19332:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 643 00000100:00080000:1.0:1788838041.657547:0:19332:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788838041.657553:0:19332:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff889affb25800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788838041.657573:0:19332:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ae7ea9c00 x1875732037091584/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838041.657585:0:19332:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838041.657587:0:19332:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788838041.657589:0:19332:0:(import.c:65:import_set_state_nolock()) ffff889ad20f0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838041.657591:0:19332:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 643 00000100:00080000:1.0:1788838041.657593:0:19332:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788838041.657597:0:19332:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889ad20f0000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788838041.657606:0:19332:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ae7eab800 x1875732037091712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838041.657648:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037091840:0@lo:400:kworker.0 00000100:00100000:1.0:1788838041.657710:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838041.657738:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838041.657743:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037091456:0@lo:400:kworker.0 00000100:00100000:1.0:1788838041.657764:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838041.657851:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037091328:0@lo:400:kworker.0 00000100:00100000:0.0:1788838041.657885:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838041.657916:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732037092096:0@lo:400:kworker.0 00000100:00100000:0.0:1788838041.657950:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838041.657967:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788838041.657972:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037091200:0@lo:400:kworker.0 00000100:00100000:0.0:1788838041.657995:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838041.658017:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732037091968:0@lo:400:kworker.0 00000100:00100000:0.0:1788838041.658039:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838041.658309:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037091840 00000100:00100000:2.0:1788838041.658318:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037091840 00000100:00100000:2.0:1788838041.658362:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037091456 00000100:00100000:2.0:1788838041.658365:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037091456 00000100:00100000:2.0:1788838041.658377:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037092096 00000100:00100000:2.0:1788838041.658380:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037092096 00000100:00100000:2.0:1788838041.658389:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037091968 00000100:00100000:2.0:1788838041.658391:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037091968 00000100:00100000:2.0:1788838041.658407:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788838041.658422:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037091840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.658478:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037091840:12345-0@lo:400:kworker.0 Request processed in 57us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838041.658485:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788838041.658502:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788838041.658509:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037091456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.658536:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037091456:12345-0@lo:400:kworker.0 Request processed in 29us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838041.658542:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788838041.658554:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788838041.658560:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732037092096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.658592:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732037092096:12345-0@lo:400:kworker.0 Request processed in 33us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838041.658598:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788838041.658609:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788838041.658615:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732037091968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838041.658642:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732037091968:12345-0@lo:400:kworker.0 Request processed in 27us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838041.658648:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788838041.658681:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037091584:0@lo:8:kworker.0 00000100:00100000:2.0:1788838041.658711:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838041.658730:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037091712:0@lo:8:kworker.0 00000100:00100000:2.0:1788838041.658793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838041.658832:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037091584 00000100:00100000:2.0:1788838041.658836:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037091584 00000100:00100000:2.0:1788838041.658858:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037091712 00000100:00100000:2.0:1788838041.658861:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037091712 00000100:00100000:2.0:1788838041.658872:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838041.658877:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037091584:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788838041.658965:0:24266:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:2.0:1788838041.658994:0:24266:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af0c1a 00002000:00100000:2.0:1788838041.659008:0:24266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff889afca63800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788838041.659012:0:24266:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788838041.659014:0:24266:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788838041.659199:0:24266:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788838041.659223:0:24266:0:(import.c:65:import_set_state_nolock()) ffff889afca64800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838041.659272:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875732037091584:12345-0@lo:8:kworker.0 Request processed in 393us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838041.659279:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838041.659292:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788838041.659296:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037091712:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788838041.659306:0:24266:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788838041.661700:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7eabb80 x1875732037091456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838041.661719:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037091456:0@lo:400:kworker.0 00010000:00080000:0.0:1788838041.661734:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7eaaa00 x1875732037091840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838041.661743:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037091840:0@lo:400:kworker.0 00010000:00080000:0.0:1788838041.661835:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7eaad80 x1875732037091968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838041.661844:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732037091968:0@lo:400:kworker.0 00010000:00080000:0.0:1788838041.661856:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7ea9880 x1875732037092096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838041.661863:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732037092096:0@lo:400:kworker.0 00000100:00100000:1.0:1788838041.662593:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037091328 00000100:00100000:1.0:1788838041.662603:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037091328 00000100:00100000:1.0:1788838041.662652:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788838041.662661:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037091328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838041.662749:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037091328:12345-0@lo:400:kworker.0 Request processed in 90us (4863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838041.662767:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788838041.662807:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037091200 00000100:00100000:1.0:1788838041.662811:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037091200 00000100:00100000:1.0:1788838041.662837:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788838041.662843:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:3651:x1875732037091200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838041.662877:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:3651:x1875732037091200:12345-0@lo:400:kworker.0 Request processed in 34us (4880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838041.662882:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788838041.662933:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037091200:0@lo:400:kworker.0 00000100:00100000:1.0:1788838041.662945:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037091328:0@lo:400:kworker.0 00010000:00080000:0.0:1788838041.665725:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7ea9c00 x1875732037091584/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838041.665740:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838041.665750:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788838041.665758:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788838041.665770:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788838041.665773:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889affb25800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788838041.665805:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788838041.665812:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037091584:0@lo:8:kworker.0 00000004:00080000:1.0:1788838041.669014:0:23504:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788838041.669104:0:23504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 658540326377ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788838041.669111:0:23504:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788838041.669178:0:23505:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788838041.669204:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23505:1875732037092352:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788838041.669285:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838041.669315:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac69226c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838041.669331:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037092224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838041.669356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838041.669391:0:24267:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788838041.669398:0:24267:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788838041.669422:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037092224 00000100:00100000:1.0:1788838041.669429:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037092224 00000100:00100000:1.0:1788838041.669478:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788838041.669487:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875732037092224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838041.669525:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788838041.669569:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875732037092224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838041.669576:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788838041.669614:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7ea8380 x1875732037092224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838041.669631:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037092224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838041.674052:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037092352 00000100:00100000:3.0:1788838041.674064:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037092352 00000100:00100000:0.0:1788838041.674214:0:24886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788838041.674225:0:24886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23505:x1875732037092352:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788838041.675852:0:23494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:0.0:1788838041.676989:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788838041.677194:0:24886:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788838041.677201:0:24886:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788838041.677399:0:24886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23505:x1875732037092352:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3171us (8109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838041.677415:0:24886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788838041.677491:0:23505:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7eaa680 x1875732037092352/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788838057 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838041.677505:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23505:1875732037092352:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788838041.677518:0:23505:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788838041.677552:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23505:1875732037092480:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788838041.677590:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838041.677649:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac69226c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838041.677685:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037092480 00000100:00100000:3.0:1788838041.677692:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037092480 00000100:00100000:3.0:1788838041.677763:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788838041.677772:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23505:x1875732037092480:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788838041.677821:0:24267:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788838041.677857:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23505:x1875732037092480:12345-0@lo:5:osp-pre-0-1.0 Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838041.677863:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788838041.677935:0:23505:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7eaa680 x1875732037092480/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788838057 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838041.677945:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23505:1875732037092480:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788838041.677953:0:23505:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788838041.677976:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23505:1875732037092608:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788838041.677998:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838041.678166:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac69226c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838041.678218:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037092608 00000100:00100000:0.0:1788838041.678222:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037092608 00000100:00100000:0.0:1788838041.678254:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788838041.678260:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23505:x1875732037092608:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788838041.678286:0:24268:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1788838041.716551:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037091712:12345-0@lo:8:kworker.0 Request processed in 57248us (57771us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838041.716564:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788838041.716753:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad20f0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838041.716759:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838041.716763:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037091712:0@lo:8:kworker.0 00010000:00010000:2.0:1788838041.722168:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788838041.742565:0:24263:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788838041.742580:0:24263:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788838041.742837:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23505:x1875732037092608:12345-0@lo:5:osp-pre-0-1.0 Request processed in 64571us (64832us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788838041.742849:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788838041.742921:0:23505:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7eaa680 x1875732037092608/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788838057 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838041.742933:0:23505:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788838041.742952:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23505:1875732037092608:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788838041.742969:0:23505:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1788838041.743023:0:23505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23505:1875732037092736:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788838041.743062:0:23505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838041.743098:0:23505:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6e4df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838041.743130:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037092736 00000100:00100000:3.0:1788838041.743142:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037092736 00000100:00100000:3.0:1788838041.743193:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838041.743203:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23505:x1875732037092736:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788838041.743267:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23505:x1875732037092736:12345-0@lo:900:osp-pre-0-1.0 Request processed in 66us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838041.743274:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788838041.743295:0:23505:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa5f1f80 x1875732037092736/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788838057 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838041.743553:0:23505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23505:1875732037092736:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788838042.041006:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838042.041035:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037092864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838042.041111:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838042.041210:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037092864 00000100:00100000:3.0:1788838042.041219:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037092864 00000100:00100000:3.0:1788838042.041288:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788838042.041301:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037092864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838042.041339:0:22767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788838042.041402:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037092864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.041410:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788838042.041473:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037092864:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788838042.745009:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838043.769910:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838044.792950:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788838044.830337:0:25083:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788838044.830340:0:25083:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788838044.830342:0:25083:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788838044.830526:0:25083:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff889ad01d4000 00000020:01000004:2.0:1788838044.830542:0:25083:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788838044.830556:0:25083:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788838044.830569:0:25083:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff889ac857cd28) 00000020:00000080:2.0:1788838044.830586:0:25083:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788838044.864361:0:25083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788838044.866709:0:25083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788838044.866968:0:25083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788838044.867433:0:25083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788838044.867692:0:25083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788838044.867938:0:25083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788838044.868155:0:25083:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788838044.872110:0:25083:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788838044.872340:0:25083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788838044.872354:0:25083:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788838044.872365:0:25083:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x57f6d4e926af0c28 00000020:01000004:2.0:1788838044.872371:0:25083:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788838044.872393:0:25083:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788838044.872397:0:25083:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788838044.872403:0:25083:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788838044.872431:0:25083:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788838044.872435:0:25083:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788838044.880518:0:25083:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788838044.880559:0:25083:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.103@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788838044.880564:0:25083:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788838044.880566:0:25083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838044.880568:0:25083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838044.880569:0:25083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838044.880571:0:25083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838044.880572:0:25083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838044.880573:0:25083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838044.880575:0:25083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838044.880577:0:25083:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788838044.880580:0:25083:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788838044.880582:0:25083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788838044.880584:0:25083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838044.880585:0:25083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838044.880586:0:25083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838044.880588:0:25083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838044.880589:0:25083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838044.880590:0:25083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838044.880591:0:25083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838044.880592:0:25083:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788838044.880690:0:25083:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788838044.880711:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037092992:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788838044.880850:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838044.880930:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7cd7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838044.880968:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037092992 00000100:00100000:0.0:1788838044.880976:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037092992 00000100:00100000:0.0:1788838044.881071:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788838044.881081:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:25083:x1875732037092992:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788838044.881123:0:22755:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788838044.881127:0:22755:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788838044.881131:0:22755:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788838044.881458:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:25083:x1875732037092992:12345-0@lo:253:mount.lustre.0 Request processed in 378us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838044.881466:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788838044.881651:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037092992:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788838044.881665:0:25083:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788838044.881667:0:25083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788838044.881669:0:25083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788838044.881670:0:25083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838044.881678:0:25083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838044.881679:0:25083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838044.881680:0:25083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838044.881681:0:25083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788838044.881682:0:25083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838044.881683:0:25083:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788838044.881706:0:25083:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889ad01d4000 from lustre-OST0001 10000000:01000000:3.0:1788838044.881734:0:25083:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788838044.881736:0:25083:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788838044.881744:0:25083:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889af99ab370 local copy 00010000:00010000:3.0:1788838044.881753:0:25083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838044.881877:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838044.881908:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.882278:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037093120 00000100:00100000:1.0:1788838044.882285:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037093120 00000100:00100000:2.0:1788838044.882330:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788838044.882340:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:25083:x1875732037093120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838044.882414:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:25083:x1875732037093120:12345-0@lo:501:mount.lustre.0 Request processed in 76us (506us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788838044.882421:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788838044.882455:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6e4d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788838044.882469:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093120:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788838044.882481:0:25083:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788838044.882499:0:25083:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788838044.882510:0:25083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838044.882519:0:25083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c2229c00/0x57f6d4e926af0942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0949 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838044.882547:0:25083:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889ad01d4000 10000000:01000000:2.0:1788838044.882551:0:25083:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788838044.882556:0:25083:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788838044.882559:0:25083:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788838044.882563:0:25083:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788838044.882566:0:25083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788838044.882588:0:25083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926af0c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838044.882596:0:25083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926af0c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838044.882713:0:25083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926af0c2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838044.882731:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838044.882758:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838044.882806:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838044.882857:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037093248 00000100:00100000:3.0:1788838044.882861:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037093248 00000100:00100000:3.0:1788838044.882881:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788838044.882886:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:25083:x1875732037093248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838044.882895:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838044.882907:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0c2f expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838044.882929:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0c2f expref: 22 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838044.882939:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c2228200/0x57f6d4e926af0c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0c2f expref: 22 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838044.882949:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2228200, rc 0) 00000100:00100000:3.0:1788838044.882985:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:25083:x1875732037093248:12345-0@lo:101:mount.lustre.0 Request processed in 98us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838044.882998:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788838044.883070:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838044.883082:0:25083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926af0c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c36 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838044.883091:0:25083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926af0c2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0c36 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788838044.884080:0:25083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788838044.884592:0:25083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838044.889452:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788838044.889510:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788838044.889526:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788838044.889540:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788838044.889555:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788838044.889568:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788838044.889581:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788838044.889594:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788838044.889678:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788838044.889709:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788838044.889715:0:25083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1788838044.889855:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838044.889923:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838044.890025:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6e4da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838044.892579:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037093376 00000100:00100000:0.0:1788838044.892595:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037093376 00000100:00100000:0.0:1788838044.892758:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788838044.892770:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:25083:x1875732037093376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838044.892994:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:25083:x1875732037093376:12345-0@lo:501:mount.lustre.0 Request processed in 226us (3070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838044.893002:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788838044.893256:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838044.893307:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838044.893361:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838044.893868:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad17e66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838044.893912:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037093504 00000100:00100000:3.0:1788838044.893918:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037093504 00000100:00100000:0.0:1788838044.893979:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788838044.893988:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:25083:x1875732037093504:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838044.894669:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:25083:x1875732037093504:12345-0@lo:503:mount.lustre.0 Request processed in 680us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838044.894679:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788838044.894818:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093504:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788838044.895246:0:25083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788838044.895330:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838044.895372:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838044.895413:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac879b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788838044.895589:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037093632 00000100:00100000:1.0:1788838044.895595:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037093632 00000100:00100000:1.0:1788838044.895635:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788838044.895643:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:25083:x1875732037093632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838044.896057:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:25083:x1875732037093632:12345-0@lo:502:mount.lustre.0 Request processed in 413us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838044.896065:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788838044.896206:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788838044.896371:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788838044.896412:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788838044.896428:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788838044.896441:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788838044.896467:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788838044.896483:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788838044.896495:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788838044.896508:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788838044.896523:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788838044.896546:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788838044.896584:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838044.896621:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838044.896771:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037093760 00000100:00100000:1.0:1788838044.896800:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037093760 00000100:00100000:1.0:1788838044.896825:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788838044.896832:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:25083:x1875732037093760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838044.896911:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:25083:x1875732037093760:12345-0@lo:502:mount.lustre.0 Request processed in 78us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838044.896918:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788838044.897036:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788838044.897079:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788838044.897087:0:25083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788838044.898072:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788838044.898081:0:25087:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788838044.898087:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838044.898089:0:25087:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788838044.898095:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838044.898109:0:25087:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff889ae7f3b370) 00000020:00000080:1.0:1788838044.898132:0:25087:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788838044.898138:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788838044.898225:0:25087:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ad01d4000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788838044.898233:0:25087:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788838044.898240:0:25087:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x57f6d4e926af0c44 00010000:00010000:1.0:1788838044.905513:0:25087:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788838044.906210:0:25087:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1788838044.907754:0:25087:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788838044.910641:0:25087:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788838044.910654:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838044.910661:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838044.910664:0:25087:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788838044.910668:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838044.910671:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838044.910673:0:25087:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788838044.910676:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788838044.910678:0:25087:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788838044.910682:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838044.910684:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838044.910686:0:25087:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788838044.910688:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838044.910691:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838044.910698:0:25087:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788838044.910702:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788838044.910729:0:25087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838044.910732:0:25087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838044.910733:0:25087:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788838044.910736:0:25087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788838044.913469:0:25083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788838044.913517:0:25083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788838044.913580:0:25083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926af0c2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c36 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838044.913593:0:25083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926af0c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c36 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838044.916629:0:25083:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ad01d4000 from 1 10000000:01000000:2.0:1788838044.916638:0:25083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838044.916682:0:25083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838044.916695:0:25083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838044.916705:0:25083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838044.916731:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093888:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838044.916823:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838044.916862:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac879b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788838044.917015:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037093888 00000100:00100000:0.0:1788838044.917022:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037093888 00000100:00100000:0.0:1788838044.917074:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788838044.917083:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:25083:x1875732037093888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838044.917097:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838044.917111:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b16000/0x57f6d4e926af0c52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0c4b expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838044.917135:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b16000/0x57f6d4e926af0c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0c4b expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838044.917146:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b16000/0x57f6d4e926af0c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0c4b expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838044.917156:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16000, rc 0) 00000100:00100000:0.0:1788838044.917214:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:25083:x1875732037093888:12345-0@lo:101:mount.lustre.0 Request processed in 131us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838044.917232:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788838044.917409:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037093888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838044.917427:0:25083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838044.917435:0:25083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788838044.918754:0:25083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788838044.919094:0:25083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838044.919279:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788838044.919303:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788838044.919316:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788838044.919329:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788838044.919342:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788838044.919355:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788838044.919368:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788838044.919394:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788838044.919409:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788838044.919421:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788838044.919433:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788838044.919450:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788838044.919455:0:25083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788838044.919516:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838044.919590:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.919826:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad6231b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838044.921112:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037094016 00000100:00100000:0.0:1788838044.921121:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037094016 00000100:00100000:0.0:1788838044.921207:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788838044.921217:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:25083:x1875732037094016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838044.921360:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:25083:x1875732037094016:12345-0@lo:501:mount.lustre.0 Request processed in 143us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838044.921368:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788838044.921460:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838044.921502:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838044.921548:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.921724:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad6231b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838044.921824:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037094144 00000100:00100000:3.0:1788838044.921829:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037094144 00000100:00100000:3.0:1788838044.921852:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788838044.921858:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:25083:x1875732037094144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838044.921928:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:25083:x1875732037094144:12345-0@lo:503:mount.lustre.0 Request processed in 69us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838044.921934:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788838044.922010:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094144:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788838044.922374:0:25083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788838044.922576:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838044.922688:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.922720:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad6231f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838044.922794:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037094272 00000100:00100000:0.0:1788838044.922799:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037094272 00000100:00100000:0.0:1788838044.922826:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788838044.922833:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aca1c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:25083:x1875732037094272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788838044.922920:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aca1c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:25083:x1875732037094272:12345-0@lo:502:mount.lustre.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838044.922928:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788838044.923031:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788838044.923197:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788838044.923222:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788838044.923235:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788838044.923247:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788838044.923258:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788838044.923272:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788838044.923285:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788838044.923297:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788838044.923309:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788838044.923319:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788838044.923331:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788838044.923350:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838044.923509:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.923532:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad6231f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838044.923672:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037094400 00000100:00100000:3.0:1788838044.923678:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037094400 00000100:00100000:3.0:1788838044.923704:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788838044.923711:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aca1c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:25083:x1875732037094400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788838044.923816:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aca1c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:25083:x1875732037094400:12345-0@lo:502:mount.lustre.0 Request processed in 104us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838044.923824:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788838044.923953:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788838044.924060:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788838044.924069:0:25083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788838044.925299:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838044.925309:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838044.925311:0:25091:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788838044.925319:0:25091:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ad01d4000 00000020:00000080:0.0:1788838044.925322:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838044.925329:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838044.925331:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838044.925333:0:25091:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788838044.925335:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838044.925338:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838044.925339:0:25091:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788838044.925342:0:25091:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ad01d4000 00000020:00000080:0.0:1788838044.925345:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838044.925507:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838044.925512:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838044.925513:0:25091:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788838044.925516:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838044.925519:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838044.925520:0:25091:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788838044.925524:0:25091:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ad01d4000 00000020:00000080:0.0:1788838044.925526:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838044.926796:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838044.926804:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838044.926806:0:25091:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788838044.926811:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838044.926814:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838044.926816:0:25091:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788838044.926821:0:25091:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ad01d4000 00000020:00000080:0.0:1788838044.926823:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838044.926865:0:25091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838044.926868:0:25091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838044.926869:0:25091:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788838044.926872:0:25091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788838044.927038:0:25083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788838044.927071:0:25083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788838044.927092:0:25083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838044.927104:0:25083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838044.927163:0:25083:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788838044.927166:0:25083:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889ad01d4000 10000000:01000000:1.0:1788838044.927170:0:25083:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889ad01d4000 10000000:01000000:1.0:1788838044.927186:0:25083:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788838044.927191:0:25083:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ad01d4000 from 1 10000000:01000000:1.0:1788838044.927194:0:25083:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838044.927233:0:25083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af0c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838044.927241:0:25083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af0c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838044.927251:0:25083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af0c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838044.927275:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788838044.927342:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.927397:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad62313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838044.931515:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037094528 00000100:00100000:1.0:1788838044.931537:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037094528 00000100:00100000:1.0:1788838044.931596:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788838044.931672:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:25083:x1875732037094528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838044.931690:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838044.931708:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9b000/0x57f6d4e926af0c60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0c59 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838044.931735:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9b000/0x57f6d4e926af0c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0c59 expref: 24 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838044.931748:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9b000/0x57f6d4e926af0c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0c59 expref: 24 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838044.931757:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b000, rc 0) 00000100:00100000:1.0:1788838044.931849:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037094528:12345-0@lo:101:mount.lustre.0 Request processed in 244us (4506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838044.931855:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788838044.931911:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838044.931928:0:25083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af0c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c60 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838044.931937:0:25083:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af0c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0c60 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788838044.936470:0:25083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788838044.936773:0:25083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838044.936974:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788838044.937010:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788838044.937024:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788838044.937046:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788838044.937058:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788838044.937070:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788838044.937082:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788838044.937094:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788838044.937108:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788838044.937121:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788838044.937133:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788838044.937145:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788838044.937157:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788838044.937169:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788838044.937206:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788838044.937221:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788838044.937233:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788838044.937245:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788838044.937256:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788838044.937270:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788838044.937282:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788838044.937294:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788838044.937306:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788838044.937318:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788838044.937330:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788838044.937343:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788838044.937356:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788838044.937369:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788838044.937393:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788838044.937409:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788838044.937437:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788838044.937450:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788838044.937462:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788838044.937473:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788838044.937487:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788838044.937500:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788838044.937520:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788838044.937533:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788838044.937546:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788838044.937558:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788838044.937570:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788838044.937583:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788838044.937595:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788838044.937607:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788838044.937619:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788838044.937632:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788838044.937655:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788838044.937671:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788838044.937797:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788838044.937819:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788838044.937835:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788838044.937840:0:25083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788838044.937925:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838044.937993:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.946833:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad6231900 going to sleep for 11 seconds 00000100:00100000:2.0:1788838044.946978:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037094656 00000100:00100000:2.0:1788838044.947450:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037094656 00000100:00100000:2.0:1788838044.947518:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788838044.947528:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037094656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838044.947760:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037094656:12345-0@lo:501:mount.lustre.0 Request processed in 233us (9766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838044.947769:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788838044.949535:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838044.949590:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838044.949717:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.949755:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad6231900 going to sleep for 11 seconds 00000100:00100000:1.0:1788838044.949817:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037094784 00000100:00100000:1.0:1788838044.949823:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037094784 00000100:00100000:1.0:1788838044.949864:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788838044.949873:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037094784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838044.949972:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037094784:12345-0@lo:503:mount.lustre.0 Request processed in 99us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838044.950681:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788838044.950746:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094784:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788838044.951794:0:25083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788838044.951873:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838044.951939:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.951971:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad62313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838044.952004:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037094912 00000100:00100000:1.0:1788838044.952010:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037094912 00000100:00100000:1.0:1788838044.952049:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788838044.952057:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037094912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838044.952152:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037094912:12345-0@lo:502:mount.lustre.0 Request processed in 95us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838044.952160:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788838044.952222:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037094912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788838044.952401:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788838044.952428:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788838044.952442:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788838044.952455:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788838044.952468:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788838044.952480:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788838044.952492:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788838044.952503:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788838044.952529:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788838044.952543:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788838044.952555:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788838044.952566:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788838044.952579:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788838044.952599:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788838044.952611:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788838044.952623:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788838044.952634:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788838044.952645:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788838044.952658:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788838044.952671:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788838044.952682:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788838044.952694:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788838044.952706:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788838044.952721:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788838044.952745:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788838044.952762:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788838044.952806:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788838044.952825:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788838044.952838:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788838044.952851:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788838044.952864:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788838044.952876:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788838044.952888:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788838044.952901:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788838044.952913:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788838044.952925:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788838044.952938:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788838044.952950:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788838044.952963:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788838044.952975:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788838044.952997:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788838044.953016:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788838044.953029:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788838044.953041:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788838044.953053:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788838044.953065:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788838044.953084:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788838044.953097:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788838044.953132:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037095040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838044.953186:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.953207:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad62313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838044.957263:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037095040 00000100:00100000:1.0:1788838044.957281:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037095040 00000100:00100000:1.0:1788838044.957341:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788838044.957351:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037095040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838044.958283:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037095040:12345-0@lo:502:mount.lustre.0 Request processed in 929us (5103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838044.958293:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788838044.958370:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037095040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788838044.960741:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788838044.960772:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788838044.960827:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037095168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838044.960894:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.960934:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037095168 00000100:00100000:1.0:1788838044.960940:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037095168 00000100:00100000:1.0:1788838044.960980:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788838044.961681:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037095168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788838044.961813:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037095168:12345-0@lo:502:mount.lustre.0 Request processed in 824us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838044.961822:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788838044.961880:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad62313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838044.961902:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037095168:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788838044.961958:0:25083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788838044.961969:0:25083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788838044.972873:0:25096:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788838044.972891:0:25096:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff889ae7f38000) 00000020:00000080:1.0:1788838044.972916:0:25096:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788838044.973030:0:25096:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ad01d4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788838044.973034:0:25096:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ad01d4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788838044.973037:0:25096:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ad01d4000 3 00010000:00080000:1.0:1788838044.973074:0:25096:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c24d3000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788838044.975730:0:25096:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788838044.976285:0:25096:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788838044.976329:0:25096:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788838044.976341:0:25096:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x57f6d4e926af0c6e 00000100:00080000:1.0:1788838044.976352:0:25096:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788838044.976358:0:25096:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8899c24d3000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788838044.976404:0:25096:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ae7eaaa00 x1875732037095296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838044.976436:0:25096:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788838044.976486:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838044.976491:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838044.976494:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838044.976497:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838044.976526:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788838044.976529:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788838044.976531:0:38:0:(import.c:65:import_set_state_nolock()) ffff889ad20f0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838044.976536:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 658 00000100:00080000:1.0:1788838044.976545:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788838044.976550:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889ad20f0000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788838044.976562:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4bac700 x1875732037095936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838044.976716:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037095552:0@lo:400:kworker.0 00000100:00100000:1.0:1788838044.976812:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.976844:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732037096192:0@lo:400:kworker.0 00000100:00100000:1.0:1788838044.976865:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.976883:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788838044.976889:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037095424:0@lo:400:kworker.0 00000100:00100000:1.0:1788838044.976913:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.976928:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732037096064:0@lo:400:kworker.0 00000100:00100000:1.0:1788838044.976946:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.976967:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037095808:0@lo:400:kworker.0 00000100:00100000:3.0:1788838044.977096:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037095296:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788838044.977200:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037095552 00000100:00100000:2.0:1788838044.977208:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037095552 00000100:00100000:2.0:1788838044.977247:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037096192 00000100:00100000:2.0:1788838044.977250:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037096192 00000100:00100000:2.0:1788838044.977271:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037096064 00000100:00100000:2.0:1788838044.977275:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037096064 00000100:00100000:2.0:1788838044.977301:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838044.977309:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037095552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838044.977760:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037095680:0@lo:400:kworker.0 00000100:00100000:3.0:1788838044.977847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838044.977874:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037095936:0@lo:8:kworker.0 00000100:00100000:3.0:1788838044.977896:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838044.977925:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037095936 00000100:00100000:3.0:1788838044.977929:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037095936 00000100:00100000:3.0:1788838044.977950:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788838044.977955:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875732037095936:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788838044.978023:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875732037095936:12345-0@lo:8:kworker.0 Request processed in 65us (125us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788838044.978031:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788838044.978065:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838044.978073:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad20f0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838044.978077:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788838044.978081:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037095936:0@lo:8:kworker.0 00000100:00100000:1.0:1788838044.978272:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838044.978306:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037095808 00000100:00100000:1.0:1788838044.978310:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037095808 00000100:00100000:1.0:1788838044.978340:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788838044.978347:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037095808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838044.978398:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037095808:12345-0@lo:400:kworker.0 Request processed in 51us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838044.978405:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788838044.978436:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c4badc00 x1875732037095808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838044.978448:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037095808:0@lo:400:kworker.0 00000100:00100000:2.0:1788838044.978633:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037095552:12345-0@lo:400:kworker.0 Request processed in 1323us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838044.978641:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838044.978655:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037095296 00000100:00100000:2.0:1788838044.978658:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037095296 00000100:00100000:2.0:1788838044.978670:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788838044.978678:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732037096192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838044.978709:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732037096192:12345-0@lo:400:kworker.0 Request processed in 33us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838044.978715:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788838044.978725:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788838044.978731:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732037096064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838044.978759:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732037096064:12345-0@lo:400:kworker.0 Request processed in 29us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838044.978766:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788838044.978871:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788838044.978876:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875732037095296:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788838044.978893:0:22763:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:3.0:1788838044.979009:0:22763:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x57f6d4e926af0c75 00000004:00100000:3.0:1788838044.979024:0:22763:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788838044.979051:0:22763:0:(import.c:65:import_set_state_nolock()) ffff889aff1ab000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838044.979091:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875732037095296:12345-0@lo:38:llog_process_th.0 Request processed in 213us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838044.979097:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788838044.979132:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7eaaa00 x1875732037095296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838044.979143:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838044.979149:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788838044.979155:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788838044.979160:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788838044.979163:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c24d3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788838044.979168:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037095296:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788838044.981526:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c4badf80 x1875732037096064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838044.981546:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732037096064:0@lo:400:kworker.0 00010000:00080000:1.0:1788838044.981559:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7eaa680 x1875732037095552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838044.981568:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037095552:0@lo:400:kworker.0 00010000:00080000:1.0:1788838044.981579:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c4bad500 x1875732037096192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838044.981588:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732037096192:0@lo:400:kworker.0 00000100:00080000:2.0:1788838044.982773:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838044.982793:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838044.982813:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037095424 00000100:00100000:2.0:1788838044.982823:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037095424 00000100:00100000:2.0:1788838044.982879:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788838044.982889:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037095424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838044.982980:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037095424:12345-0@lo:400:kworker.0 Request processed in 93us (6066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838044.983714:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788838044.983768:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037095424:0@lo:400:kworker.0 00000100:00100000:0.0:1788838044.984773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838044.986541:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037096320:0@lo:400:kworker.0 00000100:00100000:0.0:1788838044.986592:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838044.986764:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037095680 00000100:00100000:2.0:1788838044.986794:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037095680 00000100:00100000:2.0:1788838044.986848:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788838044.986856:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037095680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838044.986915:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037095680:12345-0@lo:400:kworker.0 Request processed in 59us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838044.986922:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788838044.987504:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037096320 00000100:00100000:3.0:1788838044.987516:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037096320 00000100:00100000:3.0:1788838044.987558:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788838044.987567:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037096320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838044.987622:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037096320:12345-0@lo:400:kworker.0 Request processed in 57us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838044.987629:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788838044.987756:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838044.987841:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037095680:0@lo:400:kworker.0 00010000:00080000:0.0:1788838044.987855:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c4bae680 x1875732037096320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838044.987865:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037096320:0@lo:400:kworker.0 00000020:01000004:2.0:1788838044.988032:0:25096:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788838044.988056:0:25096:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8899c4ba0000) 00000020:00000080:2.0:1788838044.988080:0:25096:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788838044.988165:0:25096:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ad01d4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788838044.988169:0:25096:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ad01d4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788838044.988181:0:25096:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ad01d4000 3 00010000:00080000:2.0:1788838044.988210:0:25096:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c37e7800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788838044.995417:0:25096:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788838044.995694:0:25096:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788838044.995745:0:25096:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788838044.995758:0:25096:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x57f6d4e926af0c83 00000100:00080000:0.0:1788838044.995770:0:25096:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788838044.995791:0:25096:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8899c37e7800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788838044.995826:0:25096:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4490000 x1875732037096448/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838044.995864:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875732037096448:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838044.995942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838044.996131:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037096448 00000100:00100000:0.0:1788838044.996138:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037096448 00000100:00100000:0.0:1788838044.996182:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838044.996190:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875732037096448:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788838044.996214:0:22764:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:0.0:1788838044.996244:0:22764:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x57f6d4e926af0c8a 00000004:00100000:0.0:1788838044.996258:0:22764:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788838044.996287:0:22764:0:(import.c:65:import_set_state_nolock()) ffff8899c36a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838044.996337:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875732037096448:12345-0@lo:38:llog_process_th.0 Request processed in 146us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838044.996344:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788838044.997670:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c4490000 x1875732037096448/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838044.997683:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838044.997693:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788838044.997701:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788838044.997706:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788838044.997719:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c37e7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788838044.997726:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875732037096448:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788838044.997758:0:25096:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788838044.997802:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788838044.997808:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788838044.997811:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788838044.997814:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788838044.998568:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788838044.998910:0:25083:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788838044.998942:0:25083:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788838044.998962:0:25083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af0c59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c60 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838044.998974:0:25083:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af0c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c60 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788838044.999164:0:25083:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788838044.999166:0:25083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838044.999168:0:25083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838044.999169:0:25083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838044.999181:0:25083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838044.999183:0:25083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838044.999184:0:25083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838044.999186:0:25083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838044.999193:0:25083:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838044.999197:0:25083:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788838044.999199:0:25083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788838044.999200:0:25083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838044.999201:0:25083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838044.999203:0:25083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838044.999204:0:25083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838044.999205:0:25083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838044.999206:0:25083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838044.999207:0:25083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838044.999208:0:25083:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838044.999231:0:25083:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788838044.999248:0:25083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037096576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788838044.999312:0:25083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838044.999397:0:25083:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa73ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838045.004547:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037096576 00000100:00100000:3.0:1788838045.004565:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037096576 00000100:00100000:3.0:1788838045.004639:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788838045.004650:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037096576:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788838045.004686:0:22757:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788838045.004701:0:22757:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788838045.010225:0:22757:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788838045.010268:0:22757:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788838045.010617:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:25083:x1875732037096576:12345-0@lo:253:mount.lustre.0 Request processed in 5956us (11291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838045.010629:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 20000000:01000000:1.0:1788838045.010732:0:22778:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788838045.010738:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788838045.010757:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838045.010773:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c1a9be00/0x57f6d4e926af0c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0bfe expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838045.011075:0:22778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0c0c expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838045.011084:0:22778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838045.011124:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0c0c expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838045.011138:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0c0c expref: 23 pid: 22757 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838045.011166:0:22778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d14a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037096704:0@lo:104: 00000100:00100000:1.0:1788838045.011215:0:22778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788838045.011300:0:22778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c1a9be00/0x57f6d4e926af0c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0bfe expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838045.011309:0:22778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c1a9be00/0x57f6d4e926af0c05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0bfe expref: 23 pid: 22755 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838045.011318:0:22778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d16300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037096832:0@lo:104: 00000100:00100000:1.0:1788838045.011339:0:22778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838045.011413:0:25083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:25083:1875732037096576:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788838045.011425:0:25083:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788838045.011428:0:25083:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788838045.011430:0:25083:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838045.011432:0:25083:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838045.011433:0:25083:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838045.011434:0:25083:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838045.011436:0:25083:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838045.011437:0:25083:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838045.011439:0:25083:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838045.011441:0:25083:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788838045.011458:0:25083:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1788838045.013696:0:25083:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788838045.016581:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037096704 00000100:00100000:3.0:1788838045.016597:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037096704 00000100:00100000:1.0:1788838045.016718:0:22778:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad6231900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838045.016814:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037096832 00000100:00100000:3.0:1788838045.016818:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037096832 00000100:00100000:3.0:1788838045.016839:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788838045.016849:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+4:22778:x1875732037096704:12345-0@lo:104: 00010000:00010000:3.0:1788838045.016866:0:22746:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838045.016970:0:22746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788838045.016977:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+4:22778:x1875732037096704:12345-0@lo:104: Request processed in 129us (5762us total) trans 0 rc 0/0 00010000:00010000:2.0:1788838045.017098:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838045.017105:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.017114:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788838045.017118:0:22751:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.017142:0:22751:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838045.017150:0:22751:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838045.017156:0:22751:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838045.017203:0:22751:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.017211:0:22751:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838045.017229:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.017238:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0c13 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.017251:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838045.017253:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838045.017255:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788838045.017320:0:25083:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788838045.017326:0:25083:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788838045.017368:0:25083:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 00000100:00100000:1.0:1788838045.017475:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037096960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838045.017517:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838045.017578:0:22778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d14a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037096704:0@lo:104: 00000100:00100000:3.0:1788838045.017671:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788838045.017694:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788838045.017703:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:22778:x1875732037096832:12345-0@lo:104: 00010000:00010000:3.0:1788838045.017712:0:22746:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838045.017832:0:22746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788838045.017839:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:22778:x1875732037096832:12345-0@lo:104: Request processed in 138us (6499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838045.017846:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788838045.017861:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838045.017866:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838045.017874:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17a00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788838045.017878:0:24294:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838045.017885:0:24294:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838045.017893:0:24294:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838045.017899:0:24294:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838045.017915:0:24294:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838045.017922:0:24294:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838045.017938:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838045.017945:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926af0bfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0c05 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838045.017970:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838045.017972:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838045.017974:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788838045.018119:0:25083:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788838045.018137:0:25083:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788838045.018162:0:25083:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788838045.019204:0:25083:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788838045.019461:0:25083:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788838045.019762:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037096960 00000100:00100000:0.0:1788838045.019772:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037096960 00010000:00010000:0.0:1788838045.019821:0:22749:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0c0c expref: 24 pid: 22757 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838045.019856:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788838045.019865:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:3649:x1875732037096960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838045.019878:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838045.019884:0:22749:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0c0c expref: 24 pid: 22757 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838045.019896:0:22749:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0c0c expref: 24 pid: 22757 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838045.019922:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0c0c expref: 24 pid: 22757 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838045.019937:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838045.020007:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:3649:x1875732037096960:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (2489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838045.020015:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788838045.023759:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037097088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838045.023850:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838045.027417:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037097088 00000100:00100000:2.0:1788838045.027429:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037097088 00010000:00010000:2.0:1788838045.027465:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c1a9be00/0x57f6d4e926af0c05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0bfe expref: 23 pid: 22755 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838045.027509:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788838045.027518:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:3650:x1875732037097088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838045.027532:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838045.027538:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c1a9be00/0x57f6d4e926af0c05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0bfe expref: 23 pid: 22755 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.027551:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c1a9be00/0x57f6d4e926af0c05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0bfe expref: 23 pid: 22755 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.027574:0:22748:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.027584:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788838045.027601:0:22748:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016863305s 00010000:00010000:2.0:1788838045.027605:0:22748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.027612:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.027618:0:22748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.027624:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.027648:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9aa00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838045.027652:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.027660:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.027669:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838045.027679:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838045.027753:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:3650:x1875732037097088:12345-0@lo:103:ldlm_bl.0 Request processed in 236us (3903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838045.027761:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788838045.027826:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037097088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838045.028597:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9be00/0x57f6d4e926af0c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0bfe expref: 22 pid: 22755 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838045.028613:0:22778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d16300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22778:1875732037096832:0@lo:104: 00010000:00010000:1.0:1788838045.028636:0:22778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838045.028645:0:22778:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838045.028651:0:22778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838045.028673:0:22778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af0c91 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838045.030159:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3649:1875732037096960:0@lo:103:ldlm_bl.0 00000040:00080000:0.0:1788838045.241694:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788838045.822810:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788838045.910022:0:25149:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788838045.910422:0:25149:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788838046.392949:0:22759:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788838046.392957:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8899c277b800 from 14 10000000:01000000:2.0:1788838046.392963:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788838046.393023:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926af0c98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838046.393036:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926af0c98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838046.393047:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926af0c98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838046.393086:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037097216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838046.393162:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838046.393218:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838046.393341:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037097216 00000100:00100000:3.0:1788838046.393350:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037097216 00000100:00100000:3.0:1788838046.393402:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788838046.393412:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:22759:x1875732037097216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838046.393424:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838046.393437:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0c9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0c98 expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838046.393459:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0c98 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838046.393469:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c2228400/0x57f6d4e926af0c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0c98 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838046.393478:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2228400, rc 0) 00000100:00100000:3.0:1788838046.393527:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:22759:x1875732037097216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838046.393534:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788838046.393734:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037097216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838046.393750:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926af0c98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c9f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838046.393759:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926af0c98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0c9f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838046.393837:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037097344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788838046.393870:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838046.393883:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838046.393946:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037097344 00000100:00100000:0.0:1788838046.393951:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037097344 00000100:00100000:0.0:1788838046.393982:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788838046.393989:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:22759:x1875732037097344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788838046.394014:0:22757:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788838046.394031:0:22757:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788838046.394034:0:22757:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788838046.394118:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:22759:x1875732037097344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838046.394124:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788838046.394305:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037097344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788838046.394363:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788838046.394370:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926af0c98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c9f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838046.394378:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926af0c98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0c9f expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838046.394386:0:22759:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788838046.394387:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8899c30c6000 from 14 10000000:01000000:2.0:1788838046.394390:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788838046.394407:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926af0ca6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838046.394424:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926af0ca6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838046.394433:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926af0ca6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838046.394446:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037097472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838046.394472:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838046.394502:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0188e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838046.394666:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037097472 00000100:00100000:0.0:1788838046.394670:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037097472 00000100:00100000:0.0:1788838046.394704:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788838046.394711:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:22759:x1875732037097472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838046.394719:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838046.394729:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0cad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0ca6 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838046.394747:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0ca6 expref: 24 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838046.394763:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17a00/0x57f6d4e926af0cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0ca6 expref: 24 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838046.394771:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17a00, rc 0) 00000100:00100000:0.0:1788838046.394831:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:22759:x1875732037097472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838046.394837:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788838046.394945:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037097472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838046.394957:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926af0ca6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0cad expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838046.394965:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926af0ca6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0cad expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838046.395017:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037097600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788838046.395046:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838046.395073:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0188e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838046.395158:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037097600 00000100:00100000:3.0:1788838046.395163:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037097600 00000100:00100000:3.0:1788838046.395193:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788838046.395201:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:22759:x1875732037097600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788838046.395213:0:22755:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788838046.395226:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788838046.395235:0:22755:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788838046.395313:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:22759:x1875732037097600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838046.395320:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788838046.395424:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037097600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788838046.395463:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788838046.395469:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926af0ca6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0cad expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838046.395477:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926af0ca6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0cad expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838046.652488:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037097728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838046.652572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838046.652965:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037097728 00000100:00100000:0.0:1788838046.652974:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037097728 00000100:00100000:0.0:1788838046.653705:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788838046.653719:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037097728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838046.653760:0:22767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788838046.653854:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037097728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838046.653862:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788838046.653962:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037097728:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788838046.841929:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838047.033072:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838027/real 1788838027] req@ffff889afc3f7480 x1875732037083904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838047 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838047.033101:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889afc3f7480 x1875732037083904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838047 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838047.033112:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838027/real 1788838027] req@ffff889afc3f5880 x1875732037084032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838047 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838047.033123:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889afc3f5880 x1875732037084032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788838047 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838047.033150:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889aded39800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838047.033168:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788838047.033172:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037083904:0@lo:8:kworker.0 00000100:00080000:2.0:1788838047.033177:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ac4e49000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838047.033182:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788838047.033184:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037084032:0@lo:8:kworker.0 00000100:00080000:0.0:1788838047.033296:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788838047.033301:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788838047.033304:0:38:0:(import.c:65:import_set_state_nolock()) ffff889aded39800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838047.033309:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 644 00000100:00080000:0.0:1788838047.033314:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788838047.033321:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff889aded39800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788838047.033350:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4491c00 x1875732037097984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838047.033364:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788838047.033374:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788838047.033376:0:38:0:(import.c:65:import_set_state_nolock()) ffff889ac4e49000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838047.033379:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 644 00000100:00080000:0.0:1788838047.033382:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788838047.033385:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff889ac4e49000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788838047.033396:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4493480 x1875732037098112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838047.033423:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788838047.033426:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788838047.033428:0:38:0:(import.c:65:import_set_state_nolock()) ffff889ad20f0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838047.033432:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889ad20f0000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788838047.033440:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4491880 x1875732037098496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838047.033481:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037098368:0@lo:400:kworker.0 00000100:00100000:0.0:1788838047.033536:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838047.033562:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037099008:0@lo:400:kworker.0 00000100:00100000:0.0:1788838047.033584:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838047.033600:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788838047.033604:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037098624:0@lo:400:kworker.0 00000100:00100000:0.0:1788838047.033621:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838047.033645:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037099136:0@lo:400:kworker.0 00000100:00100000:0.0:1788838047.033663:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838047.033689:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037098368 00000100:00100000:0.0:1788838047.033695:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037098368 00000100:00100000:0.0:1788838047.033742:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788838047.033756:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037098368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838047.033817:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037098368:12345-0@lo:400:kworker.0 Request processed in 62us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838047.033824:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788838047.033844:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037099008 00000100:00100000:0.0:1788838047.033847:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037099008 00000100:00100000:0.0:1788838047.033869:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037098624 00000100:00100000:0.0:1788838047.033872:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037098624 00000100:00100000:0.0:1788838047.033881:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037099136 00000100:00100000:0.0:1788838047.033883:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037099136 00000100:00100000:0.0:1788838047.033894:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788838047.033899:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037099008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838047.033923:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037099008:12345-0@lo:400:kworker.0 Request processed in 23us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838047.033929:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788838047.033937:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788838047.033942:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037098624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838047.033959:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037098624:12345-0@lo:400:kworker.0 Request processed in 17us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838047.033964:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788838047.033972:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788838047.033977:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732037099136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838047.033994:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732037099136:12345-0@lo:400:kworker.0 Request processed in 18us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838047.033999:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788838047.034023:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037097984:0@lo:8:kworker.0 00000100:00100000:0.0:1788838047.034050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838047.034074:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037098112:0@lo:8:kworker.0 00000100:00100000:0.0:1788838047.034089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838047.034101:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037098496:0@lo:8:kworker.0 00000100:00100000:0.0:1788838047.034681:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838047.034718:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037097984 00000100:00100000:0.0:1788838047.034723:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037097984 00000100:00100000:0.0:1788838047.034738:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037098112 00000100:00100000:0.0:1788838047.034740:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037098112 00000100:00100000:0.0:1788838047.034746:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037098496 00000100:00100000:0.0:1788838047.034748:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037098496 00000100:00100000:0.0:1788838047.034755:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838047.034760:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037097984:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788838047.034805:0:24266:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 663 last 0 00000020:00000080:0.0:1788838047.034833:0:24266:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af0cb4 00002000:00100000:0.0:1788838047.034846:0:24266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8899c36a7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788838047.034850:0:24266:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788838047.034852:0:24266:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788838047.034920:0:24266:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788838047.034941:0:24266:0:(import.c:65:import_set_state_nolock()) ffff8899c36a6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838047.034979:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875732037097984:12345-0@lo:8:kworker.0 Request processed in 218us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838047.034985:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838047.034996:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788838047.035000:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037098112:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788838047.035013:0:24266:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 663 last 0 00000020:00000080:0.0:1788838047.035032:0:24266:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af0cbb 00002000:00100000:0.0:1788838047.035044:0:24266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8899c36a1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788838047.035047:0:24266:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788838047.035049:0:24266:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788838047.035174:0:24266:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788838047.035188:0:24266:0:(import.c:65:import_set_state_nolock()) ffff8899c36a3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838047.035217:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875732037098112:12345-0@lo:8:kworker.0 Request processed in 215us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838047.035224:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788838047.035237:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788838047.035240:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037098496:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788838047.035255:0:24266:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 663 last 0 00000020:00000080:0.0:1788838047.035280:0:24266:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af0cc2 00002000:00100000:0.0:1788838047.035286:0:24266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8899c36a7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788838047.035289:0:24266:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788838047.035291:0:24266:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788838047.035313:0:24266:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788838047.035328:0:24266:0:(import.c:65:import_set_state_nolock()) ffff8899c36a0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838047.035354:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875732037098496:12345-0@lo:8:kworker.0 Request processed in 112us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838047.035361:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788838047.035406:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4492a00 x1875732037098624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838047.035419:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037098624:0@lo:400:kworker.0 00010000:00080000:0.0:1788838047.035429:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4492680 x1875732037099136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838047.035448:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037099136:0@lo:400:kworker.0 00010000:00080000:0.0:1788838047.035460:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4490700 x1875732037098368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838047.035467:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037098368:0@lo:400:kworker.0 00010000:00080000:0.0:1788838047.035476:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4493b80 x1875732037099008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838047.035482:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037099008:0@lo:400:kworker.0 00010000:00080000:0.0:1788838047.035514:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4491c00 x1875732037097984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838047.035522:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838047.035528:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788838047.035535:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788838047.035540:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788838047.035542:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889aded39800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788838047.035558:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788838047.035563:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037097984:0@lo:8:kworker.0 00010000:00080000:0.0:1788838047.035575:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4493480 x1875732037098112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838047.035581:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838047.035585:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788838047.035589:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788838047.035591:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788838047.035593:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ac4e49000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788838047.035609:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788838047.035613:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037098112:0@lo:8:kworker.0 00010000:00080000:0.0:1788838047.035640:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4491880 x1875732037098496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838047.035649:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788838047.035653:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788838047.035656:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788838047.035659:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad20f0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788838047.035669:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788838047.035672:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037098496:0@lo:8:kworker.0 00000004:00080000:0.0:1788838047.035713:0:23507:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788838047.035734:0:23507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23507:1875732037099392:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788838047.036499:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037097856:0@lo:400:kworker.0 00000100:00100000:2.0:1788838047.036550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838047.036582:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732037098752:0@lo:400:kworker.0 00000100:00100000:2.0:1788838047.036602:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838047.036620:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037099264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838047.036652:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838047.036673:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788838047.036679:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037098240:0@lo:400:kworker.0 00000100:00100000:2.0:1788838047.036711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838047.036729:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037098880:0@lo:400:kworker.0 00000100:00100000:2.0:1788838047.036748:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788838047.036773:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838047.036804:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838047.036807:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788838047.036820:0:22786:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788838047.036891:0:22786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 663908113893ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788838047.036897:0:22786:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788838047.036939:0:22789:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788838047.036955:0:22789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22789:1875732037099648:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788838047.036978:0:22789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838047.036994:0:22789:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0188480 going to sleep for 11 seconds 00000100:00100000:2.0:1788838047.037015:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037099264 00000100:00100000:2.0:1788838047.037020:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037099264 00000100:00100000:2.0:1788838047.037064:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788838047.037072:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875732037099264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838047.037093:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788838047.037129:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875732037099264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838047.037146:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788838047.037668:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037098752 00000100:00100000:2.0:1788838047.037673:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037098752 00000100:00100000:2.0:1788838047.037709:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037098240 00000100:00100000:2.0:1788838047.037712:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037098240 00000100:00100000:2.0:1788838047.037724:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037098880 00000100:00100000:2.0:1788838047.037727:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037098880 00000100:00100000:2.0:1788838047.037744:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788838047.037750:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732037098752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838047.037822:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732037098752:12345-0@lo:400:kworker.0 Request processed in 71us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838047.037829:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788838047.037843:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788838047.037850:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037098240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838047.037878:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037098240:12345-0@lo:400:kworker.0 Request processed in 29us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838047.037884:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788838047.037895:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788838047.037901:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037098880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838047.037967:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037098880:12345-0@lo:400:kworker.0 Request processed in 66us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838047.037974:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788838047.037994:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838047.037997:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838047.037999:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788838047.038028:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4493800 x1875732037098240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838047.038043:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037098240:0@lo:400:kworker.0 00010000:00080000:2.0:1788838047.038070:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4493100 x1875732037098880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838047.038080:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037098880:0@lo:400:kworker.0 00010000:00080000:2.0:1788838047.038092:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4491f80 x1875732037098752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838047.038112:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732037098752:0@lo:400:kworker.0 00010000:00080000:2.0:1788838047.038124:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85e9880 x1875732037099264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838047.038147:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037099264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838047.038169:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838047.038179:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037099520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838047.038204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838047.038229:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037099520 00000100:00100000:2.0:1788838047.038232:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037099520 00000100:00100000:2.0:1788838047.038257:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788838047.038263:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732037099520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838047.038275:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788838047.038303:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732037099520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838047.038310:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788838047.038323:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788838047.038335:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5f0a80 x1875732037099520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838047.038359:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037099520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838047.038377:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037099648 00000100:00100000:2.0:1788838047.038380:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037099648 00000100:00100000:2.0:1788838047.038405:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788838047.038411:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22789:x1875732037099648:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788838047.038671:0:22787:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:2.0:1788838047.038695:0:22787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22787:1875732037099904:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788838047.038722:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838047.038746:0:22787:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4fc46c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788838047.038767:0:22788:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788838047.041259:0:24886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037099904 00000100:00100000:0.0:1788838047.041272:0:24886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037099904 00000100:00100000:0.0:1788838047.041338:0:24886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788838047.041348:0:24886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22787:x1875732037099904:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788838047.041705:0:23506:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788838047.041941:0:23506:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 663913111283ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788838047.041950:0:23506:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788838047.041983:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037097856 00000100:00100000:0.0:1788838047.041988:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037097856 00000100:00100000:0.0:1788838047.042025:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788838047.042033:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037097856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838047.042109:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037097856:12345-0@lo:400:kworker.0 Request processed in 77us (5558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838047.042116:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788838047.042157:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838047.042172:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037099776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838047.042207:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788838047.044914:0:22788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 663916134908ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788838047.044927:0:22788:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788838047.046053:0:22742:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:0.0:1788838047.046587:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838047.046614:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037099776 00000100:00100000:0.0:1788838047.046743:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037099776 00000100:00100000:0.0:1788838047.046850:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788838047.046860:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875732037099776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788838047.046890:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788838047.046978:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875732037099776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (4770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838047.046986:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788838047.047032:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5f0a80 x1875732037099776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838047.047053:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037099776:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788838047.047078:0:24886:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788838047.047085:0:24886:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788838047.047089:0:24886:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000100:00100000:2.0:1788838047.048123:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037097856:0@lo:400:kworker.0 00002000:00080000:2.0:1788838047.050070:0:24266:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788838047.050088:0:24266:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1788838047.050093:0:24266:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00000100:00100000:1.0:1788838047.056567:0:23507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838047.056614:0:23507:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f76f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838047.058641:0:24268:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788838047.058657:0:24268:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:0.0:1788838047.059537:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.059548:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080f3283f/0x57f6d4e926af0cc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.059636:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.059642:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.059650:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080f3283f/0x57f6d4e926af0cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.059750:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080f3283f/0x57f6d4e926af0cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.059761:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080f3283f/0x57f6d4e926af0cc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.059768:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080f3283f/0x57f6d4e926af0cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.059810:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838047.059822:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838047.059828:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080f3283f/0x57f6d4e926af0cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.059836:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.059840:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080f3283f/0x57f6d4e926af0cc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.059849:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080f3283f/0x57f6d4e926af0cc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.059866:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080f3283f/0x57f6d4e926af0cc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.059873:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080f3283f/0x57f6d4e926af0cc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.059895:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.059897:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.059898:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838047.060052:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037099392 00000100:00100000:0.0:1788838047.060061:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037099392 00000100:00100000:0.0:1788838047.060185:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788838047.060195:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23507:x1875732037099392:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788838047.063954:0:23494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:0.0:1788838047.063984:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.063994:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d696b65d/0x57f6d4e926af0cd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064010:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.064014:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.064021:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d696b65d/0x57f6d4e926af0cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064034:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d696b65d/0x57f6d4e926af0cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064044:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d696b65d/0x57f6d4e926af0cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064051:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d696b65d/0x57f6d4e926af0cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064076:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838047.064577:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.064584:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000775235f0/0x57f6d4e926af0cd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064592:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.064595:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.064599:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000775235f0/0x57f6d4e926af0cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064607:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000775235f0/0x57f6d4e926af0cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064614:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000775235f0/0x57f6d4e926af0cd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064621:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000775235f0/0x57f6d4e926af0cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064637:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788838047.064740:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838047.064747:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d696b65d/0x57f6d4e926af0cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064755:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.064760:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d696b65d/0x57f6d4e926af0cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064796:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d696b65d/0x57f6d4e926af0cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064814:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d696b65d/0x57f6d4e926af0cd0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064822:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d696b65d/0x57f6d4e926af0cd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064839:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838047.064842:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000775235f0/0x57f6d4e926af0cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064848:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.064852:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000775235f0/0x57f6d4e926af0cd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064860:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000775235f0/0x57f6d4e926af0cd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064869:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000775235f0/0x57f6d4e926af0cd7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064875:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000775235f0/0x57f6d4e926af0cd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.064899:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.064900:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.064902:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838047.065824:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.065832:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d34552/0x57f6d4e926af0cde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.065845:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.065850:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.065855:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006d34552/0x57f6d4e926af0cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.065867:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006d34552/0x57f6d4e926af0cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.065875:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d34552/0x57f6d4e926af0cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.065882:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006d34552/0x57f6d4e926af0cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.065898:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838047.066199:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.066205:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c8dd6f1/0x57f6d4e926af0ce5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.066224:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.066227:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.066232:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c8dd6f1/0x57f6d4e926af0ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.066241:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c8dd6f1/0x57f6d4e926af0ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.066322:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c8dd6f1/0x57f6d4e926af0ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.066330:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c8dd6f1/0x57f6d4e926af0ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.066345:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788838047.066812:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.066818:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c868044d/0x57f6d4e926af0cec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.066826:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.066829:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.066834:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c868044d/0x57f6d4e926af0cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.066843:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c868044d/0x57f6d4e926af0cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.066863:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c868044d/0x57f6d4e926af0cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.066870:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c868044d/0x57f6d4e926af0cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.066879:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788838047.067116:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.067122:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008356c149/0x57f6d4e926af0cf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.067131:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.067134:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.067150:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008356c149/0x57f6d4e926af0cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.067160:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008356c149/0x57f6d4e926af0cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.067168:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008356c149/0x57f6d4e926af0cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.067175:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008356c149/0x57f6d4e926af0cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.067194:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788838047.067650:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.067656:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cbd8425/0x57f6d4e926af0cfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.067729:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.067733:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.067737:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cbd8425/0x57f6d4e926af0cfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.067746:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cbd8425/0x57f6d4e926af0cfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.067753:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cbd8425/0x57f6d4e926af0cfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.067759:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cbd8425/0x57f6d4e926af0cfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.067767:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788838047.068017:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.068022:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050022b30/0x57f6d4e926af0d01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068030:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.068039:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.068043:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050022b30/0x57f6d4e926af0d01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068051:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050022b30/0x57f6d4e926af0d01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068058:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050022b30/0x57f6d4e926af0d01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068064:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050022b30/0x57f6d4e926af0d01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068071:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788838047.068476:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.068483:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006723e43e/0x57f6d4e926af0d08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068492:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.068494:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.068498:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006723e43e/0x57f6d4e926af0d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068508:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006723e43e/0x57f6d4e926af0d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068516:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006723e43e/0x57f6d4e926af0d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068528:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006723e43e/0x57f6d4e926af0d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068537:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1788838047.068827:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788838047.068834:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006d34552/0x57f6d4e926af0cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068842:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.068847:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d34552/0x57f6d4e926af0cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068857:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d34552/0x57f6d4e926af0cde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068873:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006d34552/0x57f6d4e926af0cde lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068881:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006d34552/0x57f6d4e926af0cde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068898:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788838047.068902:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c8dd6f1/0x57f6d4e926af0ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068920:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.068923:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c8dd6f1/0x57f6d4e926af0ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068931:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c8dd6f1/0x57f6d4e926af0ce5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068942:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c8dd6f1/0x57f6d4e926af0ce5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068949:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c8dd6f1/0x57f6d4e926af0ce5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068962:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788838047.068965:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c868044d/0x57f6d4e926af0cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068972:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.068975:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c868044d/0x57f6d4e926af0cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068982:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c868044d/0x57f6d4e926af0cec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.068992:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c868044d/0x57f6d4e926af0cec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069006:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c868044d/0x57f6d4e926af0cec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069018:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788838047.069022:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008356c149/0x57f6d4e926af0cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069028:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.069032:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008356c149/0x57f6d4e926af0cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069040:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008356c149/0x57f6d4e926af0cf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069051:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008356c149/0x57f6d4e926af0cf3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069058:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008356c149/0x57f6d4e926af0cf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069069:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788838047.069072:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cbd8425/0x57f6d4e926af0cfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069079:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.069087:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cbd8425/0x57f6d4e926af0cfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069095:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cbd8425/0x57f6d4e926af0cfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069106:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cbd8425/0x57f6d4e926af0cfa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069113:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cbd8425/0x57f6d4e926af0cfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069125:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838047.069128:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050022b30/0x57f6d4e926af0d01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069146:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.069149:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050022b30/0x57f6d4e926af0d01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069157:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050022b30/0x57f6d4e926af0d01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069168:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050022b30/0x57f6d4e926af0d01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069175:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050022b30/0x57f6d4e926af0d01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069193:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838047.069197:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006723e43e/0x57f6d4e926af0d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069203:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.069207:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006723e43e/0x57f6d4e926af0d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069215:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006723e43e/0x57f6d4e926af0d08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069225:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006723e43e/0x57f6d4e926af0d08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069233:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006723e43e/0x57f6d4e926af0d08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.069313:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.069316:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.069318:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.069325:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838047.071251:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.071263:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000567d3636/0x57f6d4e926af0d0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.071279:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.071292:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.071300:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000567d3636/0x57f6d4e926af0d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.071313:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000567d3636/0x57f6d4e926af0d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.071323:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000567d3636/0x57f6d4e926af0d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.071331:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000567d3636/0x57f6d4e926af0d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.072729:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838047.074900:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838047.074911:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000567d3636/0x57f6d4e926af0d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.074926:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.074931:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000567d3636/0x57f6d4e926af0d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.074943:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000567d3636/0x57f6d4e926af0d0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.074963:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000567d3636/0x57f6d4e926af0d0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.074983:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000567d3636/0x57f6d4e926af0d0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.075004:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.075006:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.075008:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838047.075061:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.075068:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ae02988/0x57f6d4e926af0d16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.075080:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.075084:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.075091:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ae02988/0x57f6d4e926af0d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.075103:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ae02988/0x57f6d4e926af0d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.075112:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ae02988/0x57f6d4e926af0d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.075120:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ae02988/0x57f6d4e926af0d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.075157:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838047.076765:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838047.076789:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ae02988/0x57f6d4e926af0d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.076803:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788838047.076808:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ae02988/0x57f6d4e926af0d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.076818:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ae02988/0x57f6d4e926af0d16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.076838:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ae02988/0x57f6d4e926af0d16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.076845:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ae02988/0x57f6d4e926af0d16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.076867:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.076869:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.076871:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788838047.076889:0:25204:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788838047.076895:0:25204:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788838047.076987:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23507:x1875732037099392:12345-0@lo:7:osp-pre-1-1.0 Request processed in 16790us (20424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838047.076999:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788838047.077054:0:23507:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85ead80 x1875732037099392/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788838063 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838047.077069:0:23507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ead80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23507:1875732037099392:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788838047.077082:0:23507:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788838047.077121:0:23507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d17480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23507:1875732037100032:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788838047.077168:0:23507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838047.077201:0:23507:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af8f73f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838047.077219:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037100032 00000100:00100000:1.0:1788838047.077225:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037100032 00000100:00100000:1.0:1788838047.077262:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788838047.077271:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23507:x1875732037100032:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788838047.077296:0:25204:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788838047.077327:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23507:x1875732037100032:12345-0@lo:5:osp-pre-1-1.0 Request processed in 57us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838047.077334:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00010000:0.0:1788838047.078313:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838047.078330:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000538e861d/0x57f6d4e926af0d1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.078472:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.078478:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838047.078484:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000538e861d/0x57f6d4e926af0d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.078499:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000538e861d/0x57f6d4e926af0d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.078509:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000538e861d/0x57f6d4e926af0d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.078517:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000538e861d/0x57f6d4e926af0d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.078534:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788838047.079682:0:23507:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889b00d17480 x1875732037100032/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788838063 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838047.079699:0:23507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d17480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23507:1875732037100032:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788838047.079714:0:23507:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788838047.079758:0:23507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d17480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23507:1875732037100160:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788838047.079838:0:23507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838047.079866:0:23507:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af8f73f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838047.079885:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037100160 00000100:00100000:1.0:1788838047.079892:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037100160 00000100:00100000:1.0:1788838047.079927:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788838047.079937:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23507:x1875732037100160:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788838047.079973:0:25204:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:0.0:1788838047.080214:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838047.080223:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000538e861d/0x57f6d4e926af0d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.080235:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.080240:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000538e861d/0x57f6d4e926af0d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.080251:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000538e861d/0x57f6d4e926af0d1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.080277:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000538e861d/0x57f6d4e926af0d1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.080286:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000538e861d/0x57f6d4e926af0d1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.080308:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.080311:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.080313:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838047.083590:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.083604:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0d24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.083623:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.084444:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.084452:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.084471:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.084482:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.084490:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.084514:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838047.084822:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838047.084834:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.084843:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788838047.084847:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.084858:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0d24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.084876:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0d24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.084884:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0d24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.084905:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.084907:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.084909:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838047.085523:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.085531:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af0d2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.085542:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.085546:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.085551:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af0d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.085573:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af0d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.085582:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af0d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.085590:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af0d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.085613:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838047.086524:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.086532:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0d32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.086544:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.086546:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.086551:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.086560:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.086568:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.086588:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.086603:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788838047.086725:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838047.086732:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af0d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.086741:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.086746:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af0d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.086755:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af0d2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.086770:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af0d2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.086789:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af0d2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.086819:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838047.086822:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.086829:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.086832:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.086839:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0d32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.086848:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0d32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.086855:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0d32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.086867:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.086868:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.086870:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838047.088809:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.088822:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0d39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.088839:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.088843:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.088849:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.088863:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.088871:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.088878:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0d39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.088907:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838047.089182:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838047.089190:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0d39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.089198:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.089210:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0d39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.089220:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0d39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.089238:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0d39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.089245:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0d39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.089267:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.089269:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.089270:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.089752:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.089918:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838047.090232:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.090239:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0d40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.090259:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.090263:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.090269:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.090280:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.090288:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.090297:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.090316:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838047.090710:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838047.090716:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.090725:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9ae00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.090729:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.090739:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0d40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.090754:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0d40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.090771:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0d40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.090816:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.090818:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.090819:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788838047.093308:0:22742:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788838047.093466:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.093476:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af0d47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.093493:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.093498:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.093504:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af0d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.093520:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af0d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.093530:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af0d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.093545:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af0d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.093560:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.093571:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.093576:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af0d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.093584:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.093589:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af0d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.093598:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af0d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.093614:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af0d47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.093622:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af0d47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.093707:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.093709:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.093711:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.094068:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.094081:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098dc129a/0x57f6d4e926af0d4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094090:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.094093:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.094098:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098dc129a/0x57f6d4e926af0d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094107:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098dc129a/0x57f6d4e926af0d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094116:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098dc129a/0x57f6d4e926af0d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094123:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098dc129a/0x57f6d4e926af0d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094150:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.094159:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.094164:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098dc129a/0x57f6d4e926af0d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094171:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6daa00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.094175:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098dc129a/0x57f6d4e926af0d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094183:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098dc129a/0x57f6d4e926af0d4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094200:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098dc129a/0x57f6d4e926af0d4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094207:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098dc129a/0x57f6d4e926af0d4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094220:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.094222:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.094223:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.094516:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.094522:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f2b8799/0x57f6d4e926af0d55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094531:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.094534:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.094538:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f2b8799/0x57f6d4e926af0d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094546:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f2b8799/0x57f6d4e926af0d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094553:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f2b8799/0x57f6d4e926af0d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094560:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f2b8799/0x57f6d4e926af0d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094592:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838047.094592:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.094598:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0d5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.094607:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.094610:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.094614:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.094623:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.094642:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.094648:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.094667:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788838047.094700:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838047.094705:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f2b8799/0x57f6d4e926af0d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094712:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.094716:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f2b8799/0x57f6d4e926af0d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094724:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f2b8799/0x57f6d4e926af0d55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094735:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f2b8799/0x57f6d4e926af0d55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094743:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f2b8799/0x57f6d4e926af0d55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094755:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.094759:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094765:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9bc00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.094768:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094928:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0d5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094940:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0d5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094947:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0d5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.094961:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.094962:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.094964:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838047.094979:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.094985:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0d63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.094993:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.094996:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.095001:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.095009:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.095018:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.095025:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.095054:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.095306:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.095312:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095320:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.095324:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095331:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0d63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095396:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0d63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095416:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0d63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095431:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.095433:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.095435:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.095477:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.095483:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0d6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095491:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=663s v=(0 0) 00010000:00010000:0.0:1788838047.095492:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.095494:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.095499:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095507:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095514:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095520:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095532:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.095539:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.095547:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095553:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.095556:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095563:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0d6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095573:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0d6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095580:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0d6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.095878:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.095880:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.095881:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.096152:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.096159:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037ab2f23/0x57f6d4e926af0d71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096170:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.096173:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.096178:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037ab2f23/0x57f6d4e926af0d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096197:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037ab2f23/0x57f6d4e926af0d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096206:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037ab2f23/0x57f6d4e926af0d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096213:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037ab2f23/0x57f6d4e926af0d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096231:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788838047.096470:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.096476:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f20d9e5/0x57f6d4e926af0d78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096485:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.096488:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.096492:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f20d9e5/0x57f6d4e926af0d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096501:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f20d9e5/0x57f6d4e926af0d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096508:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f20d9e5/0x57f6d4e926af0d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096526:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f20d9e5/0x57f6d4e926af0d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096537:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788838047.096877:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.096884:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069b26122/0x57f6d4e926af0d7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096892:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.096895:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.096899:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069b26122/0x57f6d4e926af0d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096908:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069b26122/0x57f6d4e926af0d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096916:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069b26122/0x57f6d4e926af0d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096923:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069b26122/0x57f6d4e926af0d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.096924:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838047.096930:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037ab2f23/0x57f6d4e926af0d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096934:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788838047.096938:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.096940:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838047.096943:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037ab2f23/0x57f6d4e926af0d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096944:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f20d9e5/0x57f6d4e926af0d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.096951:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037ab2f23/0x57f6d4e926af0d71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096957:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac7400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.096959:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f20d9e5/0x57f6d4e926af0d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096966:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f20d9e5/0x57f6d4e926af0d78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.096967:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037ab2f23/0x57f6d4e926af0d71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.096975:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037ab2f23/0x57f6d4e926af0d71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096976:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f20d9e5/0x57f6d4e926af0d78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096983:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f20d9e5/0x57f6d4e926af0d78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.096994:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.096994:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.096995:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.096997:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.096997:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069b26122/0x57f6d4e926af0d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.097008:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838047.097012:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069b26122/0x57f6d4e926af0d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.097019:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069b26122/0x57f6d4e926af0d7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.097029:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069b26122/0x57f6d4e926af0d7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.097036:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069b26122/0x57f6d4e926af0d7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838047.097050:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.097051:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.097053:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.097058:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.097229:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.097235:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067116395/0x57f6d4e926af0d86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097243:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.097246:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.097250:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067116395/0x57f6d4e926af0d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097259:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067116395/0x57f6d4e926af0d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097272:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067116395/0x57f6d4e926af0d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097279:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067116395/0x57f6d4e926af0d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097290:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.097296:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.097299:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067116395/0x57f6d4e926af0d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097305:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac7e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.097308:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067116395/0x57f6d4e926af0d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097316:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067116395/0x57f6d4e926af0d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097326:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067116395/0x57f6d4e926af0d86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097333:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067116395/0x57f6d4e926af0d86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097408:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.097414:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.097416:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838047.097432:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.097438:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0d8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.097447:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.097450:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.097454:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.097464:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.097472:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.097479:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0d8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.097490:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788838047.097803:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.097809:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018f8a0b5/0x57f6d4e926af0d94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097817:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.097820:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.097825:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018f8a0b5/0x57f6d4e926af0d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097834:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018f8a0b5/0x57f6d4e926af0d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097841:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018f8a0b5/0x57f6d4e926af0d94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097848:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018f8a0b5/0x57f6d4e926af0d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838047.097849:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.097855:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926af0d9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097860:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788838047.097862:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.097870:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.097874:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926af0d9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.097883:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926af0d9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.097891:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926af0d9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.097898:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926af0d9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.097917:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788838047.097922:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838047.097926:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0d8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097933:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9be00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.097937:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0d8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097956:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0d8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097968:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0d8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097975:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0d8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.097990:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838047.097993:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018f8a0b5/0x57f6d4e926af0d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.098000:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.098003:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018f8a0b5/0x57f6d4e926af0d94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.098011:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018f8a0b5/0x57f6d4e926af0d94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.098020:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018f8a0b5/0x57f6d4e926af0d94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.098027:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018f8a0b5/0x57f6d4e926af0d94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.098051:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.098054:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926af0d9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.098060:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9aa00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.098063:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926af0d9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.098070:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926af0d9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.098079:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926af0d9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.098086:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926af0d9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.098099:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.098101:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.098102:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.098105:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838047.098108:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838047.098844:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.098852:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0da2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.098864:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.098867:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.098871:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.098881:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.098890:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.098902:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.098919:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838047.099232:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838047.099239:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.099247:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838047.099252:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.099260:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0da2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.099277:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0da2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.099285:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063680de5/0x57f6d4e926af0da2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.099299:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.099301:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.099306:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.099791:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.099799:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383dde74/0x57f6d4e926af0da9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.099810:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.099819:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.099824:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383dde74/0x57f6d4e926af0da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.099836:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000383dde74/0x57f6d4e926af0da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.099844:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383dde74/0x57f6d4e926af0da9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.099850:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000383dde74/0x57f6d4e926af0da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.099867:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788838047.100285:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.100292:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a58f2dc/0x57f6d4e926af0db0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100301:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.100304:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.100308:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a58f2dc/0x57f6d4e926af0db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100317:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a58f2dc/0x57f6d4e926af0db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100326:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a58f2dc/0x57f6d4e926af0db0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100393:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a58f2dc/0x57f6d4e926af0db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100411:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788838047.100419:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838047.100424:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000383dde74/0x57f6d4e926af0da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100430:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac7c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.100435:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000383dde74/0x57f6d4e926af0da9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100443:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000383dde74/0x57f6d4e926af0da9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100456:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000383dde74/0x57f6d4e926af0da9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100463:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000383dde74/0x57f6d4e926af0da9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100481:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.100484:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a58f2dc/0x57f6d4e926af0db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100501:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac7200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.100504:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a58f2dc/0x57f6d4e926af0db0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100512:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a58f2dc/0x57f6d4e926af0db0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100522:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a58f2dc/0x57f6d4e926af0db0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100529:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a58f2dc/0x57f6d4e926af0db0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.100540:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.100542:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.100543:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.101062:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.101069:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008be4dd1f/0x57f6d4e926af0db7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101079:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.101082:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.101087:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008be4dd1f/0x57f6d4e926af0db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101096:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008be4dd1f/0x57f6d4e926af0db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101109:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008be4dd1f/0x57f6d4e926af0db7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101115:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008be4dd1f/0x57f6d4e926af0db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101145:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838047.101156:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838047.101161:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008be4dd1f/0x57f6d4e926af0db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.101169:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838047.101173:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008be4dd1f/0x57f6d4e926af0db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.101181:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008be4dd1f/0x57f6d4e926af0db7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.101194:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008be4dd1f/0x57f6d4e926af0db7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.101202:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008be4dd1f/0x57f6d4e926af0db7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.101218:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.101220:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.101222:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.101882:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.101891:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0dbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101901:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.101904:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.101909:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101919:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101927:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0dbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101935:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101961:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.101969:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.101973:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101980:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.101984:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0dbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.101993:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0dbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.102004:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0dbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.102011:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0dbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.102025:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.102026:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.102028:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.102948:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.102955:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081575d98/0x57f6d4e926af0dc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.102967:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.102977:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.102983:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081575d98/0x57f6d4e926af0dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.102993:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081575d98/0x57f6d4e926af0dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.103002:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081575d98/0x57f6d4e926af0dc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.103008:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081575d98/0x57f6d4e926af0dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.103017:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.103019:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838047.103230:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838047.103237:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081575d98/0x57f6d4e926af0dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103245:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838047.103249:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081575d98/0x57f6d4e926af0dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103269:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081575d98/0x57f6d4e926af0dc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103283:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081575d98/0x57f6d4e926af0dc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103290:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081575d98/0x57f6d4e926af0dc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103306:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.103308:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.103310:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838047.103418:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838047.103424:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cefdc4b/0x57f6d4e926af0dcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103432:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=663s v=(0 0) 00010000:00010000:3.0:1788838047.103435:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838047.103439:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cefdc4b/0x57f6d4e926af0dcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103447:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cefdc4b/0x57f6d4e926af0dcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103454:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cefdc4b/0x57f6d4e926af0dcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103465:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cefdc4b/0x57f6d4e926af0dcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103479:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838047.103486:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838047.103490:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cefdc4b/0x57f6d4e926af0dcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103496:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838047.103499:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cefdc4b/0x57f6d4e926af0dcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103506:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cefdc4b/0x57f6d4e926af0dcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103517:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cefdc4b/0x57f6d4e926af0dcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103524:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cefdc4b/0x57f6d4e926af0dcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.103539:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.103540:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.103542:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.103943:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.103949:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007708f899/0x57f6d4e926af0dd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.103958:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.103961:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.103965:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007708f899/0x57f6d4e926af0dd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.103973:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007708f899/0x57f6d4e926af0dd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.103981:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007708f899/0x57f6d4e926af0dd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.103995:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007708f899/0x57f6d4e926af0dd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.104159:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838047.104180:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838047.104185:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007708f899/0x57f6d4e926af0dd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.104193:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788838047.104197:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007708f899/0x57f6d4e926af0dd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.104205:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007708f899/0x57f6d4e926af0dd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.104220:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007708f899/0x57f6d4e926af0dd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.104227:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007708f899/0x57f6d4e926af0dd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.104241:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.104243:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.104245:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838047.104486:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.104492:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000a3250f/0x57f6d4e926af0dda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.104501:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.104504:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.104508:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000a3250f/0x57f6d4e926af0dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.104517:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000a3250f/0x57f6d4e926af0dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.104525:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000a3250f/0x57f6d4e926af0dda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.104532:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000a3250f/0x57f6d4e926af0dda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.104655:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838047.104756:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838047.104767:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000a3250f/0x57f6d4e926af0dda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.104798:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838047.104803:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000a3250f/0x57f6d4e926af0dda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.104812:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000a3250f/0x57f6d4e926af0dda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.104825:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000a3250f/0x57f6d4e926af0dda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.104832:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000a3250f/0x57f6d4e926af0dda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.104846:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.104848:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.104850:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.104955:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.104961:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc8f07d/0x57f6d4e926af0de1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.104969:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.104972:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.104976:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc8f07d/0x57f6d4e926af0de1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.104985:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc8f07d/0x57f6d4e926af0de1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.104993:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc8f07d/0x57f6d4e926af0de1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.105000:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc8f07d/0x57f6d4e926af0de1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.105011:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838047.105019:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.105024:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0de8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105032:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.105035:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.105039:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105060:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105068:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0de8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105076:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105088:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788838047.105096:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838047.105099:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc8f07d/0x57f6d4e926af0de1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105106:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788838047.105109:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc8f07d/0x57f6d4e926af0de1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105116:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc8f07d/0x57f6d4e926af0de1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105127:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc8f07d/0x57f6d4e926af0de1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105145:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc8f07d/0x57f6d4e926af0de1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105165:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838047.105169:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105176:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788838047.105179:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0de8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105187:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0de8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105198:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0de8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105205:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000080c3989/0x57f6d4e926af0de8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.105216:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.105218:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.105220:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.105272:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.105278:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af0def lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.105290:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.105294:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.105298:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af0def lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.105307:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af0def lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.105315:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af0def lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.105322:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af0def lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.105333:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838047.105428:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838047.105434:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af0def lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.105441:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838047.105444:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af0def lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.105463:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af0def lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.105474:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af0def lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.105482:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af0def lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.105494:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.105496:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.105498:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.105585:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838047.105749:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838047.105755:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060905eba/0x57f6d4e926af0df6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.105763:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=663s v=(0 0) 00010000:00010000:3.0:1788838047.105766:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838047.105770:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060905eba/0x57f6d4e926af0df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.105987:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060905eba/0x57f6d4e926af0df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.105996:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060905eba/0x57f6d4e926af0df6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.106009:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060905eba/0x57f6d4e926af0df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.106060:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838047.106227:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838047.106233:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060905eba/0x57f6d4e926af0df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.106240:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788838047.106250:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060905eba/0x57f6d4e926af0df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.106259:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060905eba/0x57f6d4e926af0df6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.106271:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060905eba/0x57f6d4e926af0df6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.106278:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060905eba/0x57f6d4e926af0df6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.106293:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.106295:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.106297:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.106432:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.106438:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0dfd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.106447:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.106450:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.106455:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.106464:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.106483:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0dfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.106491:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838047.106561:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.106669:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.106678:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.106681:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.106685:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.106694:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.106702:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.106715:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.106832:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838047.106838:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0dfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.106845:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838047.106849:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0dfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.106858:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0dfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.106870:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0dfd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.106878:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838047.106881:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.106887:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9bc00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838047.106890:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.106908:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.106919:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e04 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.106927:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.106929:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.106931:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.107069:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788838047.107072:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788838047.107075:0:24266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0dfd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.107076:0:24886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.107212:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838047.108877:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.108890:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0e0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.108907:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.108911:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.108918:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.108931:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.108940:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0e0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.108948:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.108984:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.109165:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.109172:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.109180:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9ae00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.109185:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0e0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.109195:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0e0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.109212:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0e0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.109220:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d96e470a/0x57f6d4e926af0e0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.109247:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.109248:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.109250:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838047.109425:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838047.109432:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.109440:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=663s v=(0 0) 00010000:00010000:3.0:1788838047.109443:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838047.109448:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.109457:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.109465:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.109472:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.109499:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.109753:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.109759:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.109767:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2228a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.109771:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.109804:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.109816:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.109824:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.109837:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.109838:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.109840:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.110905:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.110913:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0e19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.110937:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.110941:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.110947:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.110958:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.110967:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0e19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.110975:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.110994:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838047.111001:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838047.111007:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.111014:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838047.111018:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.111027:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0e19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.111040:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0e19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.111047:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926af0e19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.111062:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.111063:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.111065:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.111443:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.111450:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c695b378/0x57f6d4e926af0e20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.111459:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.111463:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.111467:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c695b378/0x57f6d4e926af0e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.111476:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c695b378/0x57f6d4e926af0e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.111495:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c695b378/0x57f6d4e926af0e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.111503:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c695b378/0x57f6d4e926af0e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.111516:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.111524:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.111528:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c695b378/0x57f6d4e926af0e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.111535:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.111539:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c695b378/0x57f6d4e926af0e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.111547:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c695b378/0x57f6d4e926af0e20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.111557:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c695b378/0x57f6d4e926af0e20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.111565:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c695b378/0x57f6d4e926af0e20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.111578:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.111584:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.111586:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.112856:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.112866:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af0e27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.112881:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.112885:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.112891:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af0e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.112902:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af0e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.112910:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af0e27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.112917:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af0e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.112935:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.112944:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.112949:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af0e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.112957:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.112961:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af0e27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.112981:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af0e27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.112996:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af0e27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113004:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af0e27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113019:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.113021:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.113023:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.113316:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.113322:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0e2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113330:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.113333:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00002000:00010000:1.0:1788838047.113406:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.113413:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0e35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.113422:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.113425:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.113429:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.113440:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.113448:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0e35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.113455:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113491:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113504:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113511:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0e2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113525:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113774:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788838047.113828:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838047.113833:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113841:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.113845:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0e2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.113850:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.113854:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0e2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113866:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0e2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113873:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0e2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113885:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.113889:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113905:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.113909:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0e35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113917:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0e35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113928:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0e35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113936:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926af0e35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.113948:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.113950:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.113952:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838047.114065:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.114486:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.114493:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af0e3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.114504:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.114507:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.114512:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af0e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838047.114515:0:24886:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.114520:0:24886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0e43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.114523:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af0e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.114528:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=663s v=(0 0) 00010000:00010000:1.0:1788838047.114534:0:24886:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.114537:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af0e3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.114539:0:24886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.114545:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af0e3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.114548:0:24886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.114555:0:24886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0e43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.114560:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838047.114561:0:24886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.114567:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.114571:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af0e3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.114578:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.114581:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af0e3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.114588:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af0e3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.114600:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af0e3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.114607:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af0e3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.114620:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838047.114643:0:24886:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788838047.114677:0:24886:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:1.0:1788838047.114767:0:24886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22787:x1875732037099904:12345-0@lo:5:osp-pre-0-0.0 Request processed in 73417us (76039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838047.114815:0:24886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788838047.115769:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.115785:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.115796:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.115801:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0e43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.115811:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0e43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.115824:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0e43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.115832:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af0e43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.115847:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.115849:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.115851:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838047.115891:0:22787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22787:1875732037099904:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788838047.115905:0:22787:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1788838047.115944:0:22787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22787:1875732037100288:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788838047.115984:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838047.116019:0:22787:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdc600 going to sleep for 11 seconds 00010000:00010000:2.0:1788838047.116031:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838047.116176:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037100288 00000100:00100000:1.0:1788838047.116183:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037100288 00000100:00100000:1.0:1788838047.116229:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788838047.116238:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22787:x1875732037100288:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788838047.116271:0:24268:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00010000:2.0:1788838047.116806:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.116814:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0e4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.116828:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.116832:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.116839:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.116852:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.116861:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0e4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.116869:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.116884:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.116892:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.116896:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.116904:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.116908:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0e4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.116927:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0e4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.116939:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0e4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.116946:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7dab721/0x57f6d4e926af0e4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.116961:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.116962:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.116964:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.117442:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.117448:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a8b53be/0x57f6d4e926af0e51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.117457:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.117460:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.117464:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a8b53be/0x57f6d4e926af0e51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.117473:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a8b53be/0x57f6d4e926af0e51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.117482:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a8b53be/0x57f6d4e926af0e51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.117494:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a8b53be/0x57f6d4e926af0e51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.117508:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.117515:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.117519:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a8b53be/0x57f6d4e926af0e51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.117526:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.117530:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a8b53be/0x57f6d4e926af0e51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.117538:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a8b53be/0x57f6d4e926af0e51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.117549:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a8b53be/0x57f6d4e926af0e51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.117557:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a8b53be/0x57f6d4e926af0e51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.117569:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.117571:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.117572:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838047.119185:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838047.119204:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5c97e8f/0x57f6d4e926af0e58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.119218:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=663s v=(0 0) 00010000:00010000:2.0:1788838047.119222:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838047.119228:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5c97e8f/0x57f6d4e926af0e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.119242:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5c97e8f/0x57f6d4e926af0e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.119251:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5c97e8f/0x57f6d4e926af0e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.119259:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5c97e8f/0x57f6d4e926af0e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.119275:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.119285:0:24294:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.119291:0:24294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5c97e8f/0x57f6d4e926af0e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.119298:0:24294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.119302:0:24294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5c97e8f/0x57f6d4e926af0e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.119311:0:24294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5c97e8f/0x57f6d4e926af0e58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.119331:0:24294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5c97e8f/0x57f6d4e926af0e58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.119339:0:24294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5c97e8f/0x57f6d4e926af0e58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.119411:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.122794:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.122807:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838047.125133:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838047.125155:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cefdc4b/0x57f6d4e926af0e5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.125184:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=663s v=(0 0) 00010000:00010000:3.0:1788838047.125190:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838047.125197:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cefdc4b/0x57f6d4e926af0e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.125211:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cefdc4b/0x57f6d4e926af0e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.125223:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cefdc4b/0x57f6d4e926af0e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.125231:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cefdc4b/0x57f6d4e926af0e5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.125250:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.125267:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.125274:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cefdc4b/0x57f6d4e926af0e5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.125282:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.125287:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cefdc4b/0x57f6d4e926af0e5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.125296:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cefdc4b/0x57f6d4e926af0e5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.125312:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cefdc4b/0x57f6d4e926af0e5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.125320:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cefdc4b/0x57f6d4e926af0e5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.125902:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.125904:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.125906:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838047.125922:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838047.125928:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6e107f3/0x57f6d4e926af0e66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.125937:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=663s v=(0 0) 00010000:00010000:3.0:1788838047.125940:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838047.125945:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6e107f3/0x57f6d4e926af0e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.125954:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6e107f3/0x57f6d4e926af0e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.125972:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6e107f3/0x57f6d4e926af0e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.125979:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6e107f3/0x57f6d4e926af0e66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.125992:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:2.0:1788838047.126025:0:24263:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788838047.126062:0:24263:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788838047.126082:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.126086:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6e107f3/0x57f6d4e926af0e66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.126094:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.126098:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6e107f3/0x57f6d4e926af0e66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.126107:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6e107f3/0x57f6d4e926af0e66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.126119:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6e107f3/0x57f6d4e926af0e66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.126126:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6e107f3/0x57f6d4e926af0e66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838047.126269:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22787:x1875732037100288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10028us (10280us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788838047.126281:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788838047.126421:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.126424:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.126426:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838047.126533:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838047.126540:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.126549:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=663s v=(0 0) 00010000:00010000:3.0:1788838047.126552:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838047.126556:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.126640:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.126649:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.126657:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.126690:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838047.126912:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838047.126918:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060905eba/0x57f6d4e926af0e74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.126927:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=663s v=(0 0) 00010000:00010000:3.0:1788838047.126930:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838047.126950:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060905eba/0x57f6d4e926af0e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.126960:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060905eba/0x57f6d4e926af0e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.126967:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060905eba/0x57f6d4e926af0e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838047.126974:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060905eba/0x57f6d4e926af0e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838047.127432:0:22787:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788838047.127448:0:22787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22787:1875732037100288:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788838047.127464:0:22787:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1788838047.130488:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788838047.132046:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838047.132067:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.132080:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2228a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.132085:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.132096:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.132118:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.132125:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004816a12d/0x57f6d4e926af0e6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.132157:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.132162:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060905eba/0x57f6d4e926af0e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.132168:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.132172:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060905eba/0x57f6d4e926af0e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.132180:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060905eba/0x57f6d4e926af0e74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.132209:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060905eba/0x57f6d4e926af0e74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.132217:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060905eba/0x57f6d4e926af0e74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.132232:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.132234:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.132236:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.132242:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788838047.133062:0:25084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1788838047.133098:0:25084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788838047.133104:0:25084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1788838047.134495:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838047.134506:0:24266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.134523:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1788838047.134528:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838047.134534:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.134547:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.134557:0:24266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838047.134565:0:24266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838047.134732:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:23507:x1875732037100160:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54792us (54889us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788838047.134742:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788838047.134818:0:23507:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788838047.134825:0:23507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d17480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23507:1875732037100160:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788838047.134846:0:23507:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788838047.134895:0:23507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23507:1875732037100416:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788838047.134929:0:23507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838047.134960:0:23507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c33d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788838047.134984:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037100416 00000100:00100000:3.0:1788838047.134989:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037100416 00000100:00100000:3.0:1788838047.135028:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788838047.135036:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23507:x1875732037100416:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788838047.135076:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23507:x1875732037100416:12345-0@lo:900:osp-pre-1-1.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838047.135083:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788838047.135181:0:23507:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f6d80 x1875732037100416/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788838063 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838047.135193:0:23507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23507:1875732037100416:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1788838047.138571:0:24266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838047.138631:0:22751:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838047.138641:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.138655:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9bc00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838047.138660:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.138671:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.138692:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.138699:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000028e8a0f/0x57f6d4e926af0e7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838047.138731:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.138733:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838047.138735:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788838047.139184:0:24266:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1788838047.139316:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22789:x1875732037099648:12345-0@lo:5:osp-pre-1-0.0 Request processed in 100901us (102332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838047.139326:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788838047.139572:0:22789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22789:1875732037099648:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788838047.139589:0:22789:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788838047.139634:0:22789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22789:1875732037100544:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788838047.139672:0:22789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838047.139734:0:22789:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c33d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788838047.143259:0:24886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037100544 00000100:00100000:1.0:1788838047.143272:0:24886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037100544 00000100:00100000:1.0:1788838047.144195:0:24886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788838047.144208:0:24886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22789:x1875732037100544:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788838047.144253:0:24886:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1788838047.145919:0:24886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22789:x1875732037100544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1709us (6241us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788838047.145932:0:24886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788838047.148565:0:22789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22789:1875732037100544:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788838047.148582:0:22789:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:0.0:1788838047.161932:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037100672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838047.161999:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838047.162054:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037100672 00000100:00100000:0.0:1788838047.162067:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037100672 00000100:00100000:0.0:1788838047.162110:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788838047.162117:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037100672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788838047.162161:0:22767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788838047.162202:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037100672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838047.162209:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788838047.162250:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037100672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838047.162851:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838047.162861:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037100800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838047.162895:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838047.164247:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037100800 00000100:00100000:0.0:1788838047.164258:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037100800 00000100:00100000:0.0:1788838047.164300:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788838047.164309:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037100800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838047.164331:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788838047.164975:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037100800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 664us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838047.164983:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788838047.165033:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037100800:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788838047.871161:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.889413:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788838048.895940:0:23520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788838049.912955:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838050.937004:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788838051.169746:0:25439:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788838051.773768:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838051.773833:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037100928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838051.773911:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838051.774166:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037100928 00000100:00100000:1.0:1788838051.774176:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037100928 00000100:00100000:1.0:1788838051.774234:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788838051.774244:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037100928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788838051.774278:0:23503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788838051.774334:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037100928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838051.774342:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788838051.775516:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037100928:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788838051.975082:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788838052.092093:0:25492:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788838052.092669:0:25492:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788838052.281857:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037101056:0@lo:400:kworker.0 00000100:00100000:0.0:1788838052.281933:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838052.281976:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037101568:0@lo:400:kworker.0 00000100:00100000:0.0:1788838052.282001:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.282051:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037101568 00000100:00100000:2.0:1788838052.282060:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037101568 00000100:00100000:2.0:1788838052.282120:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788838052.282364:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037101568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.282424:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037101568:12345-0@lo:400:kworker.0 Request processed in 295us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.282431:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788838052.284176:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85eb100 x1875732037101568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838052.284206:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037101568:0@lo:400:kworker.0 00000100:00100000:0.0:1788838052.284217:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037102080:0@lo:400:kworker.0 00000100:00100000:0.0:1788838052.284261:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838052.284294:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037102592:0@lo:400:kworker.0 00000100:00100000:0.0:1788838052.284317:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838052.284349:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788838052.284357:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037101184:0@lo:400:kworker.0 00000100:00100000:0.0:1788838052.284382:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838052.284401:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037101696:0@lo:400:kworker.0 00000100:00100000:0.0:1788838052.284422:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838052.284440:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037102208:0@lo:400:kworker.0 00000100:00100000:0.0:1788838052.284461:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838052.284476:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037102720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838052.284497:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838052.284531:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037101184 00000100:00100000:0.0:1788838052.284536:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037101184 00000100:00100000:0.0:1788838052.284569:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037101696 00000100:00100000:0.0:1788838052.284572:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037101696 00000100:00100000:0.0:1788838052.284590:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788838052.284598:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037101184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838052.284659:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037101184:12345-0@lo:400:kworker.0 Request processed in 60us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.284666:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788838052.284683:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788838052.284695:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037101696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838052.284726:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037101696:12345-0@lo:400:kworker.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.284732:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788838052.284761:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037101184:0@lo:400:kworker.0 00000100:00100000:0.0:1788838052.284771:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037101696:0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.285188:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037102080 00000100:00100000:2.0:1788838052.285193:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037102080 00000100:00100000:2.0:1788838052.285222:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037102592 00000100:00100000:2.0:1788838052.285225:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037102592 00000100:00100000:2.0:1788838052.285254:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037102208 00000100:00100000:2.0:1788838052.285257:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037102208 00000100:00100000:3.0:1788838052.285259:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037101312:0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.285273:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788838052.285278:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037102080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838052.285305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.285312:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037102080:12345-0@lo:400:kworker.0 Request processed in 34us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.285318:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788838052.285324:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037101824:0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.285331:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788838052.285336:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732037102592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838052.285343:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.285359:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037102336:0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.285369:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732037102592:12345-0@lo:400:kworker.0 Request processed in 33us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.285375:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788838052.285379:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.285384:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037102336 00000100:00100000:2.0:1788838052.285387:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037102336 00000100:00100000:3.0:1788838052.285388:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037102848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838052.285401:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788838052.285406:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.285406:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037102208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838052.285424:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788838052.285431:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037102208:12345-0@lo:400:kworker.0 Request processed in 25us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838052.285432:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037101440:0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.285436:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788838052.285447:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788838052.285450:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.285452:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037102336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838052.285472:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037101952:0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.285477:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037102336:12345-0@lo:400:kworker.0 Request processed in 26us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.285481:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788838052.285491:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.285507:0:24271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037102720 00000100:00100000:3.0:1788838052.285509:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732037102464:0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.285510:0:24271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037102720 00000100:00100000:3.0:1788838052.285526:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838052.285526:0:24271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037102848 00000100:00100000:2.0:1788838052.285528:0:24271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037102848 00000100:00100000:2.0:1788838052.285539:0:24271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788838052.285541:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037102976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838052.285545:0:24271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037102720:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838052.285558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788838052.285575:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85ead80 x1875732037102336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838052.285585:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037102336:0@lo:400:kworker.0 00000100:00100000:3.0:1788838052.285609:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037101056 00000100:00100000:3.0:1788838052.285613:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037101056 00002000:00000024:2.0:1788838052.285652:0:24271:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788838052.285653:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788838052.285659:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:3650:x1875732037101056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838052.285695:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:3650:x1875732037101056:12345-0@lo:400:kworker.0 Request processed in 36us (3762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838052.285702:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788838052.285720:0:24271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037102720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 175us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.285726:0:24271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788838052.285727:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037103232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838052.285736:0:24271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037102976 00000100:00100000:2.0:1788838052.285738:0:24271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037102976 00000100:00100000:3.0:1788838052.285746:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838052.285758:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838052.285758:0:24271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037103232 00000100:00100000:2.0:1788838052.285760:0:24271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037103232 00000100:00100000:3.0:1788838052.285763:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037103104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838052.285772:0:24271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788838052.285795:0:24271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037102848:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838052.285801:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788838052.285804:0:24271:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788838052.285826:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037101312 00000100:00100000:3.0:1788838052.285829:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037101312 00000100:00100000:2.0:1788838052.285831:0:24271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037102848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.285837:0:24271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788838052.285848:0:24271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788838052.285849:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037101824 00000100:00100000:3.0:1788838052.285851:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037101824 00000100:00100000:2.0:1788838052.285853:0:24271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732037102976:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838052.285860:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037101440 00000100:00100000:3.0:1788838052.285862:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037101440 00002000:00000024:2.0:1788838052.285868:0:24271:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788838052.285869:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037101952 00000100:00100000:3.0:1788838052.285870:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037101952 00000100:00100000:3.0:1788838052.285882:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788838052.285887:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037101312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.285891:0:24271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875732037102976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.285896:0:24271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788838052.285907:0:24271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788838052.285913:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037101312:12345-0@lo:400:kworker.0 Request processed in 26us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.285913:0:24271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875732037103232:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838052.285919:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00000024:2.0:1788838052.285920:0:24271:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788838052.285928:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788838052.285933:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037101824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.285944:0:24271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875732037103232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.285950:0:24271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788838052.285955:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037101824:12345-0@lo:400:kworker.0 Request processed in 22us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838052.285960:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788838052.285966:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037103104 00000100:00100000:3.0:1788838052.285969:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788838052.285969:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037103104 00000100:00100000:3.0:1788838052.285980:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732037101440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.285987:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788838052.285992:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037103104:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838052.286005:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732037101440:12345-0@lo:400:kworker.0 Request processed in 27us (555us total) trans 0 rc 0/0 00000004:00000024:2.0:1788838052.286010:0:22767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788838052.286011:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788838052.286022:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788838052.286027:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037101952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.286037:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037103104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838052.286063:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037101952:12345-0@lo:400:kworker.0 Request processed in 36us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.286064:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788838052.286068:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788838052.286085:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037102464 00000100:00100000:2.0:1788838052.286088:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037102464 00000100:00100000:3.0:1788838052.286100:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037101440:0@lo:400:kworker.0 00000100:00100000:3.0:1788838052.286109:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037101952:0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.286109:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788838052.286114:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732037102464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838052.286123:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037102976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838052.286131:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037101312:0@lo:400:kworker.0 00000100:00100000:3.0:1788838052.286140:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037101824:0@lo:400:kworker.0 00000100:00100000:2.0:1788838052.286144:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732037102464:12345-0@lo:400:kworker.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838052.286149:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788838052.286150:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037102848:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788838052.286181:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85e9880 x1875732037102464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838052.286191:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732037102464:0@lo:400:kworker.0 00000100:00100000:3.0:1788838052.286211:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037103104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838052.286220:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037103232:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788838052.286248:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85e9180 x1875732037102208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838052.286262:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037102208:0@lo:400:kworker.0 00000100:00100000:3.0:1788838052.286276:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037102720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838052.286284:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037101056:0@lo:400:kworker.0 00010000:00080000:3.0:1788838052.286294:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85e8a80 x1875732037102080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838052.286301:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037102080:0@lo:400:kworker.0 00010000:00080000:3.0:1788838052.286315:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4490000 x1875732037102592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838052.286322:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037102592:0@lo:400:kworker.0 00000100:00080000:0.0:1788838052.286814:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838052.286819:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838052.286822:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838052.286824:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:1.0:1788838052.972007:0:25542:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838052.972253:0:25542:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788838052.988163:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838053.196594:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838053.199941:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012874240 00000100:00100000:0.0:1788838053.199955:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012874240 00000100:00100000:1.0:1788838053.203979:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 115 00000100:00100000:1.0:1788838053.203991:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2392:x1875732012874240:12345-192.168.201.3@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788838053.204039:0:22756:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6a6b125b-183c-4ab6-8c98-ae42522ec309@192.168.201.3@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:1.0:1788838053.204096:0:22756:0:(genops.c:1385:class_connect()) connect: client 6a6b125b-183c-4ab6-8c98-ae42522ec309, cookie 0x57f6d4e926af0e82 00000100:00080000:1.0:1788838053.204253:0:22756:0:(import.c:65:import_set_state_nolock()) ffff8899c24d5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838053.204341:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+5:2392:x1875732012874240:12345-192.168.201.3@tcp:250:mount.lustre.0 Request processed in 349us (7758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.204349:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 115 00000100:00100000:1.0:1788838053.216556:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838053.216644:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012874368 00000100:00100000:3.0:1788838053.216654:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012874368 00000100:00100000:3.0:1788838053.216713:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:3.0:1788838053.216724:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+5:18042:x1875732012874368:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788838053.216741:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838053.216759:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0e89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003efbc expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838053.216819:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003efbc expref: 6 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838053.216832:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c2228c00/0x57f6d4e926af0e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003efbc expref: 6 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838053.216856:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2228c00, rc 0) 00000100:00100000:3.0:1788838053.216911:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+6:18042:x1875732012874368:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 188us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.216918:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:2.0:1788838053.224705:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838053.224823:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012874496 00000100:00100000:3.0:1788838053.224834:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012874496 00000100:00100000:3.0:1788838053.224884:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 117 00000100:00100000:3.0:1788838053.224893:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+6:18042:x1875732012874496:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788838053.225019:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+6:18042:x1875732012874496:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 126us (323us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788838053.225037:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 117 00000100:00100000:0.0:1788838053.226843:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838053.226920:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012874624 00000100:00100000:1.0:1788838053.226928:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012874624 00000100:00100000:1.0:1788838053.226977:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:1.0:1788838053.226986:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+6:18042:x1875732012874624:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788838053.227000:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838053.227018:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9ae00/0x57f6d4e926af0e90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003efc3 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838053.227057:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9ae00/0x57f6d4e926af0e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003efc3 expref: 7 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838053.227067:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9ae00/0x57f6d4e926af0e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003efc3 expref: 7 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838053.227075:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9ae00, rc 0) 00000100:00100000:1.0:1788838053.227171:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+7:18042:x1875732012874624:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 185us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.227178:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:1.0:1788838053.230812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838053.230895:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012874752 00000100:00100000:0.0:1788838053.230904:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012874752 00000100:00100000:0.0:1788838053.230955:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:0.0:1788838053.230964:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+7:18042:x1875732012874752:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788838053.231126:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+8:18042:x1875732012874752:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 162us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838053.231134:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:2.0:1788838053.232527:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838053.232598:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012874880 00000100:00100000:3.0:1788838053.232605:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012874880 00000100:00100000:3.0:1788838053.232650:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 120 00000100:00100000:3.0:1788838053.232659:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+8:18042:x1875732012874880:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788838053.232807:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+8:18042:x1875732012874880:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 148us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.232815:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 120 00000100:00100000:3.0:1788838053.239910:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838053.241515:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012875008 00000100:00100000:1.0:1788838053.241529:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012875008 00000100:00100000:1.0:1788838053.241600:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:1.0:1788838053.241623:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+8:18061:x1875732012875008:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788838053.241937:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+8:18061:x1875732012875008:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 315us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.241945:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:1.0:1788838053.261410:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838053.261521:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012875136 00000100:00100000:0.0:1788838053.261531:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012875136 00000100:00100000:0.0:1788838053.261591:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:0.0:1788838053.261600:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+8:18061:x1875732012875136:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788838053.261768:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+8:18061:x1875732012875136:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 169us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838053.261824:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:2.0:1788838053.273730:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838053.274072:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012875264 00000100:00100000:1.0:1788838053.274083:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012875264 00000100:00100000:1.0:1788838053.274140:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 123 00000100:00100000:1.0:1788838053.274150:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+8:18061:x1875732012875264:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788838053.274427:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+8:18061:x1875732012875264:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 276us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.274436:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 123 00000100:00100000:1.0:1788838053.279921:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838053.280001:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012875392 00000100:00100000:3.0:1788838053.280011:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012875392 00000100:00100000:3.0:1788838053.280080:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:3.0:1788838053.280091:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+8:18042:x1875732012875392:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788838053.280107:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838053.280138:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0e97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003eff4 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838053.280166:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eff4 expref: 9 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838053.280178:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c2229200/0x57f6d4e926af0e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eff4 expref: 9 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838053.280186:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2229200, rc 0) 00000100:00100000:3.0:1788838053.280264:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+9:18042:x1875732012875392:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 174us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.280271:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:3.0:1788838053.290584:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838053.290814:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012875520 00000100:00100000:1.0:1788838053.290825:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012875520 00000100:00100000:1.0:1788838053.290880:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:1.0:1788838053.290892:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+9:18042:x1875732012875520:12345-192.168.201.3@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788838053.290917:0:22756:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788838053.290941:0:22756:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788838053.290945:0:22756:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788838053.290947:0:22756:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788838053.290950:0:22756:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788838053.290952:0:22756:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788838053.293101:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+9:18042:x1875732012875520:12345-192.168.201.3@tcp:256:mount.lustre.0 Request processed in 2203us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.293114:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:2.0:1788838053.296709:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838053.296804:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012875648 00000100:00100000:0.0:1788838053.296814:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012875648 00000100:00100000:0.0:1788838053.296872:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:0.0:1788838053.296882:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+9:18042:x1875732012875648:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788838053.296898:0:22755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838053.296915:0:22755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa791000/0x57f6d4e926af0e9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003effb expref: -99 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.296943:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa791000/0x57f6d4e926af0e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003effb expref: 10 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.296954:0:22755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa791000/0x57f6d4e926af0e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003effb expref: 10 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838053.296963:0:22755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791000, rc 0) 00000100:00100000:0.0:1788838053.297017:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+10:18042:x1875732012875648:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 137us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838053.297035:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:3.0:1788838053.299483:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838053.299582:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012875776 00000100:00100000:1.0:1788838053.299591:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012875776 00000100:00100000:1.0:1788838053.299646:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 127 00000100:00100000:1.0:1788838053.299655:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+10:18042:x1875732012875776:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788838053.299842:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+10:18042:x1875732012875776:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 187us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.299851:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 127 00000100:00100000:2.0:1788838053.302079:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838053.302214:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012875904 00000100:00100000:3.0:1788838053.302224:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012875904 00000100:00100000:3.0:1788838053.302280:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 128 00000100:00100000:3.0:1788838053.302289:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+10:18042:x1875732012875904:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788838053.302431:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+10:18042:x1875732012875904:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 142us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.302440:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 128 00000100:00100000:2.0:1788838053.305630:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838053.305906:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012876032 00000100:00100000:3.0:1788838053.305916:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012876032 00000100:00100000:3.0:1788838053.305976:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:3.0:1788838053.305985:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+10:18066:x1875732012876032:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788838053.306134:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+10:18066:x1875732012876032:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 149us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.306149:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 129 00000001:00080000:1.0:1788838053.309732:0:25084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:0.0:1788838053.320087:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838053.320561:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012876160 00000100:00100000:1.0:1788838053.320572:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012876160 00000100:00100000:1.0:1788838053.320632:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:1.0:1788838053.320641:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+10:18066:x1875732012876160:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788838053.320843:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+10:18066:x1875732012876160:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 202us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.320852:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:2.0:1788838053.342764:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838053.342901:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838053.343209:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012876288 00000100:00100000:3.0:1788838053.343222:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012876288 00000100:00100000:3.0:1788838053.343276:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012876544 00000100:00100000:3.0:1788838053.343279:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012876544 00000100:00100000:3.0:1788838053.343302:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:3.0:1788838053.343309:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875732012876288:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788838053.343340:0:24119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c90cb75d-813d-4d4d-bbe3-08b26c6e8404@192.168.201.3@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:3.0:1788838053.343394:0:24119:0:(genops.c:1385:class_connect()) connect: client c90cb75d-813d-4d4d-bbe3-08b26c6e8404, cookie 0x57f6d4e926af0ea5 00000004:00100000:3.0:1788838053.343424:0:24119:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788838053.343654:0:24119:0:(import.c:65:import_set_state_nolock()) ffff889aff1af800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838053.343726:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:2392:x1875732012876288:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 415us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.343734:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:3.0:1788838053.343755:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:3.0:1788838053.343759:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875732012876544:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788838053.343806:0:24119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c90cb75d-813d-4d4d-bbe3-08b26c6e8404@192.168.201.3@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:3.0:1788838053.343840:0:24119:0:(genops.c:1385:class_connect()) connect: client c90cb75d-813d-4d4d-bbe3-08b26c6e8404, cookie 0x57f6d4e926af0eac 00000004:00100000:3.0:1788838053.343854:0:24119:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788838053.343992:0:24119:0:(import.c:65:import_set_state_nolock()) ffff889aded3c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838053.344019:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:2392:x1875732012876544:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 258us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.344039:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:2.0:1788838053.355049:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838053.355089:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838053.355215:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012876800 00000100:00100000:0.0:1788838053.355227:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012876800 00000100:00100000:0.0:1788838053.355440:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012876416 00000100:00100000:0.0:1788838053.355444:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012876416 00000100:00100000:0.0:1788838053.355471:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:0.0:1788838053.355479:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:18042:x1875732012876800:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788838053.355519:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788838053.355635:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:18042:x1875732012876800:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 155us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838053.355642:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:0.0:1788838053.355660:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:0.0:1788838053.355667:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:0:x1875732012876416:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788838053.355679:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788838053.355702:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:0:x1875732012876416:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 35us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838053.355707:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00080000:1.0:1788838053.357356:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838053.363560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838053.363597:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838053.366268:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012876672 00000100:00100000:0.0:1788838053.366284:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012876672 00000100:00080000:1.0:1788838053.366444:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838053.366501:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012876928 00000100:00100000:0.0:1788838053.366505:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012876928 00000100:00100000:3.0:1788838053.366649:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:3.0:1788838053.366662:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:0:x1875732012876672:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788838053.366703:0:24119:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788838053.366941:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:0:x1875732012876672:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 282us (3388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.366950:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:3.0:1788838053.366970:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:3.0:1788838053.366977:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18042:x1875732012876928:12345-192.168.201.3@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788838053.367008:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18042:x1875732012876928:12345-192.168.201.3@tcp:40:mount.lustre.0 Request processed in 31us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.367014:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:2.0:1788838053.370905:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838053.370945:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838053.370978:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838053.371070:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012877056 00000100:00100000:0.0:1788838053.371080:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012877056 00000100:00100000:0.0:1788838053.371130:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012877184 00000100:00100000:0.0:1788838053.371133:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012877184 00000100:00100000:0.0:1788838053.371157:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:0.0:1788838053.371164:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2392:x1875732012877056:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788838053.371208:0:25204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c90cb75d-813d-4d4d-bbe3-08b26c6e8404@192.168.201.3@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:0.0:1788838053.371240:0:25204:0:(genops.c:1385:class_connect()) connect: client c90cb75d-813d-4d4d-bbe3-08b26c6e8404, cookie 0x57f6d4e926af0eb3 00002000:00100000:0.0:1788838053.371253:0:25204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c90cb75d-813d-4d4d-bbe3-08b26c6e8404/ffff889afa764000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788838053.371264:0:25204:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788838053.371427:0:25204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788838053.371455:0:25204:0:(import.c:65:import_set_state_nolock()) ffff889ac444a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838053.371515:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:2392:x1875732012877056:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 349us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838053.371540:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:0.0:1788838053.371557:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:0.0:1788838053.371562:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2392:x1875732012877184:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788838053.371578:0:25204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c90cb75d-813d-4d4d-bbe3-08b26c6e8404@192.168.201.3@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:0.0:1788838053.371608:0:25204:0:(genops.c:1385:class_connect()) connect: client c90cb75d-813d-4d4d-bbe3-08b26c6e8404, cookie 0x57f6d4e926af0eba 00002000:00100000:0.0:1788838053.371614:0:25204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c90cb75d-813d-4d4d-bbe3-08b26c6e8404/ffff889afca99800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788838053.371621:0:25204:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788838053.371745:0:25204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788838053.371760:0:25204:0:(import.c:65:import_set_state_nolock()) ffff889afca9a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838053.371820:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:2392:x1875732012877184:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 255us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838053.371827:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:3.0:1788838053.371944:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012877312 00000100:00100000:3.0:1788838053.371950:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012877312 00000100:00100000:3.0:1788838053.371992:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:3.0:1788838053.371999:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18042:x1875732012877312:12345-192.168.201.3@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788838053.372047:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18042:x1875732012877312:12345-192.168.201.3@tcp:900:mount.lustre.0 Request processed in 48us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.372054:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:3.0:1788838053.374408:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838053.374579:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012877440 00000100:00100000:2.0:1788838053.374588:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012877440 00000100:00100000:2.0:1788838053.374639:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:2.0:1788838053.374648:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18042:x1875732012877440:12345-192.168.201.3@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788838053.378837:0:22765:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4111us 00000004:00200000:2.0:1788838053.392680:0:22765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788838053.392840:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18042:x1875732012877440:12345-192.168.201.3@tcp:33:mount.lustre.0 Request processed in 18186us (18433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838053.392850:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:3.0:1788838053.559511:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838053.559680:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012877568 00000100:00100000:2.0:1788838053.559690:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012877568 00000100:00100000:2.0:1788838053.559749:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:2.0:1788838053.559759:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18089:x1875732012877568:12345-192.168.201.3@tcp:101:mkdir.0 00010000:00010000:2.0:1788838053.559804:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838053.559830:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926af0ec1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f02c expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838053.559896:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0ec8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838053.559911:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838053.559925:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838053.559972:0:22763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838053.559976:0:22763:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838053.560064:0:22763:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838053.560093:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926af0ec1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f02c expref: 8 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838053.560111:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f02c expref: 7 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838053.560126:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:2.0:1788838053.560130:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838053.560133:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9400, rc 0) 00000100:00100000:2.0:1788838053.560198:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:18089:x1875732012877568:12345-192.168.201.3@tcp:101:mkdir.0 Request processed in 440us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838053.560204:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00010000:00010000:3.0:1788838054.009117:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838055.035278:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838055.466463:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838055.466560:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012877696 00000100:00100000:2.0:1788838055.466572:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012877696 00000100:00100000:2.0:1788838055.466659:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:2.0:1788838055.466670:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:18141:x1875732012877696:12345-192.168.201.3@tcp:41:lfs.0 00000004:00000024:2.0:1788838055.466714:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788838055.466857:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:18141:x1875732012877696:12345-192.168.201.3@tcp:41:lfs.0 Request processed in 188us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838055.466863:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00080000:1.0:1788838055.466914:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838055.472052:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838055.472167:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012877824 00000100:00100000:2.0:1788838055.472179:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012877824 00000100:00080000:1.0:1788838055.474474:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838055.474765:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:2.0:1788838055.474793:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18141:x1875732012877824:12345-192.168.201.3@tcp:41:lfs.0 00000004:00000024:2.0:1788838055.474836:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788838055.474945:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18141:x1875732012877824:12345-192.168.201.3@tcp:41:lfs.0 Request processed in 170us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838055.474953:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:0.0:1788838055.480501:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838055.480737:0:24271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012877952 00000100:00100000:2.0:1788838055.480749:0:24271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012877952 00000100:00100000:2.0:1788838055.480855:0:24271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:2.0:1788838055.480882:0:24271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18141:x1875732012877952:12345-192.168.201.3@tcp:13:lfs.0 00002000:00000024:2.0:1788838055.480917:0:24271:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788838055.481025:0:24271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18141:x1875732012877952:12345-192.168.201.3@tcp:13:lfs.0 Request processed in 145us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838055.481033:0:24271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00080000:1.0:1788838055.481175:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788838055.483041:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788838055.488254:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838055.488407:0:24271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012878080 00000100:00100000:2.0:1788838055.488426:0:24271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012878080 00000100:00100000:2.0:1788838055.489270:0:24271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00080000:1.0:1788838055.489272:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838055.489284:0:24271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18141:x1875732012878080:12345-192.168.201.3@tcp:13:lfs.0 00002000:00000024:2.0:1788838055.489319:0:24271:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788838055.489384:0:24271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18141:x1875732012878080:12345-192.168.201.3@tcp:13:lfs.0 Request processed in 105us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838055.489388:0:24271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:0.0:1788838055.616044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838055.618087:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012878208 00000100:00100000:1.0:1788838055.618103:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012878208 00000100:00100000:1.0:1788838055.618176:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:1.0:1788838055.618936:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+10:18172:x1875732012878208:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788838055.618959:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838055.619002:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af0ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003f033 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838055.619034:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af0ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f033 expref: 11 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838055.619045:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af0ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f033 expref: 11 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838055.619055:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a200, rc 0) 00000100:00100000:1.0:1788838055.619134:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18172:x1875732012878208:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 948us (3099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838055.619141:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:0.0:1788838055.629077:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838055.629471:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012878336 00000100:00100000:1.0:1788838055.629483:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012878336 00000100:00100000:1.0:1788838055.629589:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 132 00000100:00100000:1.0:1788838055.630073:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18172:x1875732012878336:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788838055.630366:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18172:x1875732012878336:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 298us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838055.630376:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 132 00000100:00100000:0.0:1788838055.644042:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838055.645350:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012878464 00000100:00100000:1.0:1788838055.645364:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012878464 00000100:00100000:1.0:1788838055.645427:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:1.0:1788838055.645438:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18172:x1875732012878464:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788838055.645588:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18172:x1875732012878464:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 151us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838055.645597:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:0.0:1788838055.654374:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838055.654526:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012878592 00000100:00100000:1.0:1788838055.654536:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012878592 00000100:00100000:1.0:1788838055.654593:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:1.0:1788838055.654603:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18180:x1875732012878592:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788838055.654751:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18180:x1875732012878592:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 148us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838055.654760:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:0.0:1788838055.680666:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838055.686378:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012878720 00000100:00100000:3.0:1788838055.686395:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012878720 00000100:00100000:3.0:1788838055.686467:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:3.0:1788838055.686478:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18180:x1875732012878720:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788838055.686639:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18180:x1875732012878720:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 162us (5985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838055.686648:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:0.0:1788838055.696528:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838055.696742:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012878848 00000100:00100000:3.0:1788838055.696753:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012878848 00000100:00100000:3.0:1788838055.696842:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00100000:3.0:1788838055.696853:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18180:x1875732012878848:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788838055.697020:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18180:x1875732012878848:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 169us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838055.697028:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00100000:0.0:1788838055.704654:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838055.704761:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012878976 00000100:00100000:1.0:1788838055.704772:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012878976 00000100:00100000:1.0:1788838055.704862:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00100000:1.0:1788838055.704873:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889acadd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18172:x1875732012878976:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788838055.704890:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838055.704909:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9bc00/0x57f6d4e926af0ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003f064 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838055.704939:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9bc00/0x57f6d4e926af0ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f064 expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838055.704949:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9bc00/0x57f6d4e926af0ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f064 expref: 12 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838055.704958:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9bc00, rc 0) 00000100:00100000:1.0:1788838055.705014:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889acadd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+12:18172:x1875732012878976:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 143us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838055.705021:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00100000:1.0:1788838055.712108:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838055.718728:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012879104 00000100:00100000:0.0:1788838055.718746:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012879104 00000100:00100000:0.0:1788838055.718848:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 138 00000100:00100000:0.0:1788838055.718859:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889acaddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+12:18172:x1875732012879104:12345-192.168.201.3@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788838055.719134:0:22755:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788838055.719152:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788838055.719155:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788838055.719159:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788838055.719162:0:22755:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788838055.719165:0:22755:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788838055.723079:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889acaddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+12:18172:x1875732012879104:12345-192.168.201.3@tcp:256:mount.lustre.0 Request processed in 4211us (10972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838055.723094:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 138 00000100:00100000:3.0:1788838055.728124:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838055.728435:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012879232 00000100:00100000:1.0:1788838055.728458:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012879232 00000100:00100000:1.0:1788838055.728520:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:1.0:1788838055.728532:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889acadda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+12:18172:x1875732012879232:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788838055.728550:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838055.728569:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0edd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003f06b expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838055.728611:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0edd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f06b expref: 13 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838055.728623:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0edd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f06b expref: 13 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838055.728632:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b800, rc 0) 00000100:00100000:1.0:1788838055.728689:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889acadda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18172:x1875732012879232:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 159us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838055.728697:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:1.0:1788838055.731470:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838055.731549:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012879360 00000100:00100000:3.0:1788838055.731559:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012879360 00000100:00100000:3.0:1788838055.731624:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:3.0:1788838055.731634:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac33df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18172:x1875732012879360:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788838055.732039:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac33df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18172:x1875732012879360:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 405us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838055.732047:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:0.0:1788838055.741387:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838055.743491:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012879488 00000100:00100000:1.0:1788838055.743507:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012879488 00000100:00100000:1.0:1788838055.743584:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:1.0:1788838055.743594:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac33dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18172:x1875732012879488:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788838055.744097:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac33dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18172:x1875732012879488:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 503us (2720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838055.744106:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:0.0:1788838055.751951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838055.752195:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012879616 00000100:00100000:3.0:1788838055.752205:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012879616 00000100:00100000:3.0:1788838055.752264:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:3.0:1788838055.752275:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac33dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18184:x1875732012879616:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788838055.752430:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac33dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18184:x1875732012879616:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 156us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838055.752438:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:0.0:1788838055.756288:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838055.756419:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012879744 00000100:00100000:1.0:1788838055.756428:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012879744 00000100:00100000:1.0:1788838055.756479:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 143 00000100:00100000:1.0:1788838055.756504:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18184:x1875732012879744:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788838055.756651:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18184:x1875732012879744:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 150us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838055.756659:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 143 00000100:00100000:0.0:1788838055.761467:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838055.761552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838055.761639:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012879872 00000100:00100000:3.0:1788838055.761649:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012879872 00000100:00100000:3.0:1788838055.761696:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012880128 00000100:00100000:3.0:1788838055.761700:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012880128 00000100:00100000:3.0:1788838055.761737:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788838055.761745:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875732012879872:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788838055.761772:0:22762:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f@192.168.201.3@tcp t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:3.0:1788838055.761840:0:22762:0:(genops.c:1385:class_connect()) connect: client 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f, cookie 0x57f6d4e926af0ee4 00000004:00100000:3.0:1788838055.761877:0:22762:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788838055.761960:0:22762:0:(import.c:65:import_set_state_nolock()) ffff889ae4651800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838055.762036:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:2392:x1875732012879872:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 291us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838055.762044:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788838055.762062:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:3.0:1788838055.762066:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875732012880128:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788838055.762082:0:22762:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f@192.168.201.3@tcp t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:3.0:1788838055.762105:0:22762:0:(genops.c:1385:class_connect()) connect: client 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f, cookie 0x57f6d4e926af0eeb 00000004:00100000:3.0:1788838055.762117:0:22762:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788838055.762167:0:22762:0:(import.c:65:import_set_state_nolock()) ffff889ae4651000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838055.762191:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:2392:x1875732012880128:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 123us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838055.762198:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:0.0:1788838055.766514:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838055.766592:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012880000 00000100:00100000:3.0:1788838055.766665:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012880000 00000100:00080000:1.0:1788838055.766794:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838055.767347:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:2.0:1788838055.767360:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:0:x1875732012880000:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788838055.767394:0:22762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788838055.767474:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:0:x1875732012880000:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 118us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838055.767481:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:1.0:1788838055.768660:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838055.769143:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838055.769298:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012880256 00000100:00100000:0.0:1788838055.769307:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012880256 00000100:00100000:0.0:1788838055.769365:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:0.0:1788838055.769374:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:0:x1875732012880256:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788838055.769398:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788838055.769463:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:0:x1875732012880256:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 90us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838055.769469:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00080000:0.0:1788838055.769492:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838055.788581:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012880384 00000100:00100000:0.0:1788838055.788598:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012880384 00000100:00100000:0.0:1788838055.789103:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:0.0:1788838055.789116:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:18172:x1875732012880384:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788838055.789287:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788838055.789369:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:18172:x1875732012880384:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 256us (20225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838055.789377:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:0.0:1788838055.795477:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838055.795590:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012880512 00000100:00100000:2.0:1788838055.795603:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012880512 00000100:00100000:2.0:1788838055.796033:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:2.0:1788838055.796045:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:18172:x1875732012880512:12345-192.168.201.3@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788838055.796136:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:18172:x1875732012880512:12345-192.168.201.3@tcp:40:mount.lustre.0 Request processed in 84us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838055.796156:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:1.0:1788838055.801499:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838055.801529:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838055.801554:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838055.801681:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012880896 00000100:00100000:3.0:1788838055.801690:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012880896 00000100:00100000:3.0:1788838055.801738:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:3.0:1788838055.801745:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:18172:x1875732012880896:12345-192.168.201.3@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788838055.801834:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:18172:x1875732012880896:12345-192.168.201.3@tcp:900:mount.lustre.0 Request processed in 89us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838055.801839:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:0.0:1788838055.802063:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012880640 00000100:00100000:0.0:1788838055.802068:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012880640 00000100:00100000:0.0:1788838055.802091:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012880768 00000100:00100000:0.0:1788838055.802094:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012880768 00000100:00100000:0.0:1788838055.802108:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:0.0:1788838055.802113:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2392:x1875732012880640:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788838055.802148:0:25204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f@192.168.201.3@tcp t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:0.0:1788838055.802178:0:25204:0:(genops.c:1385:class_connect()) connect: client 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f, cookie 0x57f6d4e926af0ef2 00002000:00100000:0.0:1788838055.802200:0:25204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f/ffff889afca9c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788838055.802211:0:25204:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788838055.802270:0:25204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788838055.802296:0:25204:0:(import.c:65:import_set_state_nolock()) ffff889afca9b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838055.802327:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:2392:x1875732012880640:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 212us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838055.802334:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:0.0:1788838055.802348:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:0.0:1788838055.802353:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2392:x1875732012880768:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788838055.802368:0:25204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f@192.168.201.3@tcp t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:0.0:1788838055.802385:0:25204:0:(genops.c:1385:class_connect()) connect: client 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f, cookie 0x57f6d4e926af0ef9 00002000:00100000:0.0:1788838055.802390:0:25204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f/ffff889afca9a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788838055.802409:0:25204:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788838055.802440:0:25204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788838055.802455:0:25204:0:(import.c:65:import_set_state_nolock()) ffff889afca9d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838055.802477:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:2392:x1875732012880768:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 123us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838055.802483:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:1.0:1788838055.804967:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838055.805078:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012881024 00000100:00100000:3.0:1788838055.805088:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012881024 00000100:00100000:3.0:1788838055.805254:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:3.0:1788838055.805266:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:18172:x1875732012881024:12345-192.168.201.3@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788838055.805367:0:22766:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788838055.805456:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:18172:x1875732012881024:12345-192.168.201.3@tcp:33:mount.lustre.0 Request processed in 193us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838055.805465:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:1.0:1788838056.037044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838056.037229:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012881152 00000100:00100000:2.0:1788838056.037241:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012881152 00000100:00100000:2.0:1788838056.037317:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:2.0:1788838056.037328:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:18206:x1875732012881152:12345-192.168.201.3@tcp:101:mkdir.0 00010000:00010000:2.0:1788838056.037350:0:24119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838056.037373:0:24119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926af0f00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f09c expref: -99 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838056.037445:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838056.037460:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838056.037473:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838056.037515:0:24119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838056.037519:0:24119:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838056.037538:0:24119:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838056.037563:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926af0f00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f09c expref: 8 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838056.037583:0:24119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f09c expref: 7 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838056.037611:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:2.0:1788838056.037614:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838056.037618:0:24119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8200, rc 0) 00000100:00100000:2.0:1788838056.037678:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+7:18206:x1875732012881152:12345-192.168.201.3@tcp:101:mkdir.0 Request processed in 352us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838056.037685:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00010000:00010000:3.0:1788838056.058160:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838056.889484:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037103360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838056.889557:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838056.889607:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037103360 00000100:00100000:2.0:1788838056.889615:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037103360 00000100:00100000:2.0:1788838056.889666:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788838056.889676:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037103360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838056.889711:0:22767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788838056.889765:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037103360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838056.889772:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788838056.889835:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037103360:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788838057.084713:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838057.402227:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037103488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838057.402305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838057.402382:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037103616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838057.402410:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838057.402438:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838057.402456:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037103744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838057.402481:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838057.402517:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037103488 00000100:00100000:3.0:1788838057.402525:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037103488 00000100:00100000:3.0:1788838057.402573:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037103744 00000100:00100000:3.0:1788838057.402577:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037103744 00000100:00100000:3.0:1788838057.402594:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788838057.402602:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037103488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838057.402630:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788838057.402670:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037103488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838057.402678:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788838057.402693:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788838057.402699:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037103744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838057.402708:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788838057.402732:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037103744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838057.402738:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788838057.402755:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037103616 00000100:00100000:3.0:1788838057.402759:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037103616 00000100:00100000:3.0:1788838057.402801:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788838057.402808:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037103616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838057.402831:0:23503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788838057.402859:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037103616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838057.402865:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788838057.402880:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838057.402911:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788838057.402933:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037103744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838057.402946:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037103616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838057.402989:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037103488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838057.403805:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838057.403818:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037103872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838057.403859:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838057.403930:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037103872 00000100:00100000:2.0:1788838057.403935:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037103872 00000100:00100000:2.0:1788838057.403989:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788838057.403998:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037103872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838057.404033:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788838057.404080:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037103872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838057.404087:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788838057.404240:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838057.404267:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037103872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838057.405249:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037104384:0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.405295:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838057.405324:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732037104896:0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.405349:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838057.405372:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788838057.405378:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037104000:0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.405409:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838057.406209:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037104512:0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.406243:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838057.406260:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037105024:0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.406281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838057.406314:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037104384 00000100:00100000:0.0:1788838057.406321:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037104384 00000100:00100000:0.0:1788838057.406364:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788838057.406380:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037104384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838057.406534:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037104000 00000100:00100000:2.0:1788838057.406538:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037104000 00000100:00100000:2.0:1788838057.406576:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788838057.406583:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:3648:x1875732037104000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838057.406625:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:3648:x1875732037104000:12345-0@lo:400:kworker.0 Request processed in 42us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838057.406633:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788838057.406666:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037104896 00000100:00100000:2.0:1788838057.406670:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037104896 00000100:00100000:2.0:1788838057.406700:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037104512 00000100:00100000:2.0:1788838057.406703:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037104512 00000100:00100000:2.0:1788838057.406714:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037105024 00000100:00100000:2.0:1788838057.406717:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037105024 00000100:00100000:2.0:1788838057.406730:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788838057.406736:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732037104896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838057.406765:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732037104896:12345-0@lo:400:kworker.0 Request processed in 29us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838057.406771:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788838057.406799:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788838057.406805:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037104512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838057.406830:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037104512:12345-0@lo:400:kworker.0 Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838057.406836:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788838057.406846:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788838057.406852:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732037105024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838057.406875:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732037105024:12345-0@lo:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838057.406881:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788838057.406901:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838057.406910:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838057.406945:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037104000:0@lo:400:kworker.0 00000100:00100000:2.0:1788838057.406973:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037104512:0@lo:400:kworker.0 00010000:00080000:2.0:1788838057.406990:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afcae8e00 x1875732037105024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838057.407001:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037105024:0@lo:400:kworker.0 00000100:00100000:2.0:1788838057.407016:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732037104896:0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.407523:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037104384:12345-0@lo:400:kworker.0 Request processed in 1141us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838057.407530:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788838057.407566:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037104256:0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.407597:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838057.407618:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732037104768:0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.407638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838057.407657:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788838057.407663:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037104128:0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.407686:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838057.407711:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732037104640:0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.407730:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838057.407753:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037104256 00000100:00100000:0.0:1788838057.407758:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037104256 00000100:00100000:0.0:1788838057.407796:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037104768 00000100:00100000:0.0:1788838057.407800:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037104768 00000100:00100000:0.0:1788838057.407819:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037104640 00000100:00100000:0.0:1788838057.407822:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037104640 00000100:00100000:0.0:1788838057.407835:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788838057.407841:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcaebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037104256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.407878:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcaebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037104256:12345-0@lo:400:kworker.0 Request processed in 36us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838057.407884:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788838057.407897:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788838057.407903:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732037104768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.407939:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732037104768:12345-0@lo:400:kworker.0 Request processed in 37us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838057.407946:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788838057.407972:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788838057.407979:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732037104640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838057.408004:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732037104640:12345-0@lo:400:kworker.0 Request processed in 26us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838057.408010:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788838057.408170:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037104384:0@lo:400:kworker.0 00000100:00100000:1.0:1788838057.409533:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037104128 00000100:00100000:1.0:1788838057.409544:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037104128 00000100:00100000:1.0:1788838057.409603:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788838057.409612:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcaead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037104128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838057.409677:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcaead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037104128:12345-0@lo:400:kworker.0 Request processed in 67us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838057.409685:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788838057.410821:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838057.410830:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838057.410833:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838057.410877:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037104128:0@lo:400:kworker.0 00000100:00100000:2.0:1788838057.410895:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732037104640:0@lo:400:kworker.0 00000100:00100000:2.0:1788838057.410909:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037104256:0@lo:400:kworker.0 00010000:00080000:2.0:1788838057.410923:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85ebb80 x1875732037104768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838057.410935:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732037104768:0@lo:400:kworker.0 00000100:00100000:2.0:1788838057.410971:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838057.410982:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037105152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838057.412167:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838057.412560:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037105152 00000100:00100000:0.0:1788838057.412570:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037105152 00000100:00100000:0.0:1788838057.412624:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788838057.412634:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037105152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788838057.412659:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788838057.413284:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037105152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 650us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838057.413293:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788838057.413348:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037105152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788838058.105050:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788838058.107234:0:23520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788838058.941222:0:25639:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1788838058.945971:0:25084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f 00000001:00100000:2.0:1788838058.945984:0:25084:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c90cb75d-813d-4d4d-bbe3-08b26c6e8404 00000001:00100000:3.0:1788838058.946757:0:22742:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f 00000001:00100000:3.0:1788838058.946769:0:22742:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c90cb75d-813d-4d4d-bbe3-08b26c6e8404 00000001:00100000:0.0:1788838058.947746:0:23494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f 00000001:00100000:0.0:1788838058.947757:0:23494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c90cb75d-813d-4d4d-bbe3-08b26c6e8404 00000001:00100000:2.0:1788838058.947964:0:24263:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7952ad5d-ec79-42cc-a48b-4f2a9f1d049f 00000001:00100000:2.0:1788838058.947974:0:24263:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c90cb75d-813d-4d4d-bbe3-08b26c6e8404 00010000:00010000:3.0:1788838059.130273:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838060.156516:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838061.057411:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838061.057452:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838061.057484:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838061.057503:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838061.057519:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838061.057535:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838061.057553:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838061.057587:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838061.057609:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838061.057639:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012881792 00000100:00100000:1.0:1788838061.057649:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012881792 00000100:00100000:1.0:1788838061.057699:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012882304 00000100:00100000:1.0:1788838061.057702:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012882304 00000100:00100000:1.0:1788838061.057716:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012881664 00000100:00100000:1.0:1788838061.057718:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012881664 00000100:00100000:1.0:1788838061.057730:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012882176 00000100:00100000:1.0:1788838061.057732:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012882176 00000100:00100000:1.0:1788838061.057748:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788838061.057757:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2394:x1875732012881792:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788838061.057853:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2394:x1875732012881792:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 96us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838061.057862:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788838061.057879:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:1.0:1788838061.057885:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2394:x1875732012882304:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788838061.057922:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2394:x1875732012882304:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 38us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838061.057929:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:1.0:1788838061.057940:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:1.0:1788838061.057946:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2394:x1875732012881664:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788838061.057970:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2394:x1875732012881664:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838061.057977:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:1.0:1788838061.057987:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:1.0:1788838061.058001:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2394:x1875732012882176:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788838061.058025:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2394:x1875732012882176:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838061.058031:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:2.0:1788838061.058913:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012881536 00000100:00100000:2.0:1788838061.058920:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012881536 00000100:00100000:2.0:1788838061.058953:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012882048 00000100:00100000:2.0:1788838061.058956:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012882048 00000100:00100000:2.0:1788838061.058968:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012881408 00000100:00100000:2.0:1788838061.058971:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012881408 00000100:00100000:2.0:1788838061.058982:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012881920 00000100:00100000:2.0:1788838061.058984:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012881920 00000100:00100000:2.0:1788838061.059000:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788838061.059007:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2394:x1875732012881536:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838061.059065:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2394:x1875732012881536:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 57us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838061.059072:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788838061.059085:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:2.0:1788838061.059091:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2394:x1875732012882048:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838061.059113:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2394:x1875732012882048:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838061.059118:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:2.0:1788838061.059128:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:2.0:1788838061.059134:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:2394:x1875732012881408:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838061.059157:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:2394:x1875732012881408:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838061.059163:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:2.0:1788838061.059174:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:2.0:1788838061.059189:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:2394:x1875732012881920:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838061.059214:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:2394:x1875732012881920:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838061.059220:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00080000:2.0:1788838061.059238:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838061.059242:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838061.059245:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838061.059247:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838061.060821:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012881280 00000100:00100000:3.0:1788838061.060832:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012881280 00000100:00100000:0.0:1788838061.063454:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 145 00000100:00100000:0.0:1788838061.063476:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:2394:x1875732012881280:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788838061.076195:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:2394:x1875732012881280:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 12709us (18776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838061.076215:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 145 00010000:00010000:2.0:1788838061.177102:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788838061.916657:0:25787:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0189aae0 20000000:00000080:0.0:1788838061.916678:0:25787:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff889afa699c00 uarg=0000000000000000 20000000:01000000:0.0:1788838061.916723:0:25787:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788838061.916729:0:25787:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788838061.916734:0:25787:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788838061.917589:0:25788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788838061.917746:0:25787:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788838061.926493:0:25787:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788838061.926527:0:25787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.926547:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926af0b6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b64 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.926556:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0b79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0b72 expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.926563:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926af0bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0bb1 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.926568:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b16000/0x57f6d4e926af0c52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0c4b expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.926577:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa791000/0x57f6d4e926af0e9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003effb expref: 12 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.926583:0:25787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0edd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f06b expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.926591:0:25787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.926636:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0edd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f06b expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.926666:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0edd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f06b expref: 12 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838061.926680:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105280:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788838061.926837:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa791000/0x57f6d4e926af0e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003effb expref: 12 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.926857:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889afa791000/0x57f6d4e926af0e9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003effb expref: 12 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838061.926866:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcaeb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105408:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788838061.926908:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b16000/0x57f6d4e926af0c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0c4b expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.926928:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac2b16000/0x57f6d4e926af0c52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0c4b expref: 23 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838061.926938:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcaeb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105536:0@lo:104: 00000100:00100000:0.0:1788838061.926977:0:25787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838061.927018:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926af0bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0bb1 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.927025:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926af0bb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0bb1 expref: 23 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838061.927033:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105664:0@lo:104: 00000100:00100000:0.0:1788838061.927051:0:25787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838061.927147:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0b79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0b72 expref: 23 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.927155:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0b79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0b72 expref: 23 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838061.927163:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105792:0@lo:104: 00000100:00100000:0.0:1788838061.927185:0:25787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838061.927201:0:25787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926af0b6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0b64 expref: 23 pid: 22755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.927209:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926af0b6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0b64 expref: 23 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838061.927217:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcaeb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105920:0@lo:104: 00000100:00100000:0.0:1788838061.927237:0:25787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838061.927247:0:25787:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838061.927722:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037105536 00000100:00100000:2.0:1788838061.927731:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037105536 00000100:00100000:0.0:1788838061.928030:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037105664 00000100:00100000:0.0:1788838061.928035:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037105664 00000100:00100000:0.0:1788838061.928056:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037105792 00000100:00100000:0.0:1788838061.928059:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037105792 00000100:00100000:0.0:1788838061.928068:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037105920 00000100:00100000:0.0:1788838061.928070:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037105920 00000100:00100000:2.0:1788838061.928163:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788838061.928174:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcaea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+6:25787:x1875732037105536:12345-0@lo:104: 00010000:00010000:2.0:1788838061.928189:0:22745:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.928523:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788838061.928531:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcaea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+6:25787:x1875732037105536:12345-0@lo:104: Request processed in 358us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838061.928538:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788838061.928559:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788838061.928565:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+5:25787:x1875732037105664:12345-0@lo:104: 00010000:00010000:2.0:1788838061.928573:0:22745:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.928609:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788838061.928613:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+5:25787:x1875732037105664:12345-0@lo:104: Request processed in 50us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838061.928632:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788838061.928647:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788838061.928652:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+4:25787:x1875732037105792:12345-0@lo:104: 00010000:00010000:2.0:1788838061.928660:0:22745:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.928693:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788838061.928697:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+4:25787:x1875732037105792:12345-0@lo:104: Request processed in 46us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838061.928702:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788838061.928715:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788838061.928720:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:25787:x1875732037105920:12345-0@lo:104: 00010000:00010000:2.0:1788838061.928728:0:22745:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.928752:0:22745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788838061.928756:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+3:25787:x1875732037105920:12345-0@lo:104: Request processed in 37us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838061.928761:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788838061.928795:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838061.928801:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.928819:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db400 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788838061.928823:0:22750:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.928852:0:22750:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838061.928860:0:22750:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838061.928866:0:22750:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788838061.928905:0:22750:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.928920:0:22750:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838061.928939:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.928947:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926af0c4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0c52 expref: -99 pid: 25083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.928958:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838061.928962:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.928966:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2228e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788838061.928969:0:22750:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.928975:0:22750:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838061.928980:0:22750:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838061.928990:0:22750:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788838061.929004:0:22750:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929009:0:22750:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838061.929021:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929027:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c2228e00/0x57f6d4e926af0bb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0bb8 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929037:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838061.929040:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929046:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788838061.929049:0:22750:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929057:0:22750:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838061.929063:0:22750:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838061.929068:0:22750:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788838061.929085:0:22750:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929091:0:22750:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838061.929103:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929110:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926af0b72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b79 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929119:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838061.929122:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929128:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2228800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788838061.929131:0:22750:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929138:0:22750:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838061.929144:0:22750:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838061.929148:0:22750:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788838061.929158:0:22750:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929164:0:22750:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838061.929169:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929176:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c2228800/0x57f6d4e926af0b64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0b6b expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929200:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838061.929202:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838061.929203:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838061.929211:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838061.929245:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037106048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838061.929295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838061.929328:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838061.929335:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037106432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838061.929536:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838061.929560:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037106048 00000100:00100000:2.0:1788838061.929566:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037106176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838061.929567:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037106048 00000100:00100000:2.0:1788838061.929587:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788838061.929592:0:22747:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b16000/0x57f6d4e926af0c52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0c4b expref: 24 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838061.929604:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838061.929607:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037106432 00000100:00100000:2.0:1788838061.929609:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037106304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838061.929610:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037106432 00010000:00010000:1.0:1788838061.929619:0:22747:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926af0b6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0b64 expref: 25 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838061.929626:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838061.929629:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037106176 00000100:00100000:1.0:1788838061.929631:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037106176 00010000:00010000:1.0:1788838061.929640:0:22747:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926af0bb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0bb1 expref: 26 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838061.929645:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037106304 00000100:00100000:2.0:1788838061.929647:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037106304 00000100:00100000:1.0:1788838061.929651:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788838061.929657:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+27:3651:x1875732037106048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838061.929659:0:22749:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0b79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0b72 expref: 27 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838061.929667:0:22747:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788838061.929671:0:22749:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788838061.929672:0:22747:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b16000/0x57f6d4e926af0c52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0c4b expref: 27 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838061.929678:0:22749:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788838061.929681:0:22747:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b16000/0x57f6d4e926af0c52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0c4b expref: 27 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838061.929692:0:22748:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788838061.929699:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788838061.929699:0:22747:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838061.929704:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+27:3651:x1875732037106432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838061.929711:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838061.929715:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926af0b6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0b64 expref: 27 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838061.929728:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+27:3651:x1875732037106048:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (435us total) trans 0 rc 0/0 00010000:00010000:2.0:1788838061.929730:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926af0b6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0b64 expref: 27 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929740:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838061.929740:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788838061.929753:0:22747:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788838061.929759:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788838061.929760:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+26:3651:x1875732037106432:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838061.929764:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+26:3648:x1875732037106176:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838061.929766:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788838061.929772:0:22747:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788838061.929796:0:22748:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788838061.929797:0:22747:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926af0bb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0bb1 expref: 25 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838061.929802:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788838061.929805:0:22747:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926af0bb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0bb1 expref: 25 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838061.929808:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+25:3648:x1875732037106304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838061.929815:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838061.929816:0:22747:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838061.929818:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0b79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0b72 expref: 25 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929825:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0b79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0b72 expref: 25 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.929834:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838061.929840:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+25:3648:x1875732037106176:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838061.929847:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788838061.929849:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+25:3648:x1875732037106304:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838061.929854:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788838061.929892:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037106304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838061.929902:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3648:1875732037106176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838061.930027:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037106432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838061.930035:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037106048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838061.930823:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838061.931212:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b16000/0x57f6d4e926af0c52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0c4b expref: 23 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838061.931230:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcaeb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105536:0@lo:104: 00010000:00010000:2.0:1788838061.931540:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926af0bb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0bb1 expref: 22 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838061.931551:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105664:0@lo:104: 00010000:00010000:2.0:1788838061.931561:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0b79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0b72 expref: 21 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838061.931586:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105792:0@lo:104: 00010000:00010000:2.0:1788838061.931600:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926af0b6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0b64 expref: 20 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838061.931607:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcaeb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105920:0@lo:104: 00000100:00100000:1.0:1788838061.941280:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838061.941288:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105280:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788838061.941302:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcaeb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1875732037105408:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788838061.941349:0:25787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838061.941357:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838061.941466:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012882432 00000100:00100000:0.0:1788838061.941474:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012882432 00010000:00010000:0.0:1788838061.941511:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0edd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f06b expref: 13 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838061.941545:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012882560 00000100:00100000:0.0:1788838061.941549:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012882560 00010000:00010000:0.0:1788838061.941561:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa791000/0x57f6d4e926af0e9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003effb expref: 14 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838061.941601:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:0.0:1788838061.941610:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6b125b-183c-4ab6-8c98-ae42522ec309+14:2396:x1875732012882432:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838061.941626:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838061.941631:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0edd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f06b expref: 14 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.941642:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0edd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f06b expref: 14 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.941660:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0edd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f06b expref: 14 pid: 22757 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.941676:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838061.941722:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc46850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:2396:x1875732012882432:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 113us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838061.941729:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:0.0:1788838061.941804:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:0.0:1788838061.941822:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6b125b-183c-4ab6-8c98-ae42522ec309+12:2396:x1875732012882560:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838061.941831:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838061.941836:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa791000/0x57f6d4e926af0e9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003effb expref: 12 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.941858:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa791000/0x57f6d4e926af0e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003effb expref: 12 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.941869:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa791000/0x57f6d4e926af0e9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003effb expref: 12 pid: 22755 timeout: 778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.941896:0:22748:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.941906:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.942277:0:22748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.942286:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.942293:0:22748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.942300:0:22748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.942306:0:22748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788838061.942310:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.942317:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.942330:0:22748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838061.942350:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838061.942374:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:2396:x1875732012882560:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 562us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838061.942388:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00010000:00010000:2.0:1788838061.942902:0:25787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.942922:0:25787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838061.942929:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa790400/0x57f6d4e926af0f0e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838062.019399:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037106560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838062.019479:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838062.019817:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037106560 00000100:00100000:1.0:1788838062.019827:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037106560 00000100:00100000:1.0:1788838062.019899:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788838062.019908:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037106560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788838062.019960:0:22767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788838062.020014:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037106560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838062.020021:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788838062.020359:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037106560:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788838062.200924:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838062.530825:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037106816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838062.530943:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.530998:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037106688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838062.531024:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.531051:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838062.531058:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037106944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838062.531092:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.531132:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037106816 00000100:00100000:3.0:1788838062.531155:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037106816 00000100:00100000:3.0:1788838062.531227:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788838062.531244:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037106816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838062.531481:0:23503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788838062.531532:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037106816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 296us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.531540:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788838062.531586:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037106816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838062.531632:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037106688 00000100:00100000:3.0:1788838062.531637:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037106688 00000100:00100000:3.0:1788838062.531662:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037106944 00000100:00100000:3.0:1788838062.531665:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037106944 00000100:00100000:3.0:1788838062.531680:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788838062.531687:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037106688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838062.531708:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788838062.531746:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037106688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.531752:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788838062.531764:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788838062.531770:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037106944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838062.531809:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788838062.531837:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037106944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.531844:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788838062.531876:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037107072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838062.531905:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.531937:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838062.531946:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037107200:0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.531975:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.532012:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037107200 00000100:00100000:3.0:1788838062.532016:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037107200 00000100:00100000:3.0:1788838062.532043:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788838062.532050:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:3650:x1875732037107200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.534819:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:3650:x1875732037107200:12345-0@lo:400:kworker.0 Request processed in 2759us (2833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.534835:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788838062.534940:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3650:1875732037107200:0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.534973:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037107072 00000100:00100000:3.0:1788838062.534980:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037107072 00000100:00100000:3.0:1788838062.535018:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788838062.535027:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037107072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838062.535049:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788838062.535091:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037107072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (3186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.535098:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788838062.535131:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037107072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838062.535166:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037106944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838062.535182:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037106688:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788838062.546963:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838062.546972:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838062.546990:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838062.547023:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037107328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838062.547099:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838062.547151:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037107328 00000100:00100000:2.0:1788838062.547159:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037107328 00000100:00100000:2.0:1788838062.547215:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788838062.547224:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037107328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838062.547261:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788838062.547311:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037107328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838062.547319:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788838062.547340:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838062.547374:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037107328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838062.557459:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838062.557493:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcaeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037107584:0@lo:400:kworker.0 00000100:00100000:1.0:1788838062.557496:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838062.557511:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037107456:0@lo:400:kworker.0 00000100:00100000:1.0:1788838062.557619:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838062.557757:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732037107840:0@lo:400:kworker.0 00000100:00100000:1.0:1788838062.557805:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838062.557845:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838062.557855:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037107712:0@lo:400:kworker.0 00000100:00100000:1.0:1788838062.558384:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838062.558391:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037107968:0@lo:400:kworker.0 00000100:00100000:1.0:1788838062.558417:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.558558:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037107456 00000100:00100000:3.0:1788838062.558566:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037107456 00000100:00100000:3.0:1788838062.558616:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037107840 00000100:00100000:3.0:1788838062.558632:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037107840 00000100:00100000:3.0:1788838062.558666:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788838062.558674:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037107456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.558721:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037107456:12345-0@lo:400:kworker.0 Request processed in 48us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.558728:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788838062.558742:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788838062.558748:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732037107840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.558769:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732037107840:12345-0@lo:400:kworker.0 Request processed in 22us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.558791:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788838062.558805:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838062.561555:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732037107840:0@lo:400:kworker.0 00000100:00100000:1.0:1788838062.561577:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037107456:0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.561812:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037107968 00000100:00100000:3.0:1788838062.561820:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037107968 00000100:00100000:3.0:1788838062.561896:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788838062.561907:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037107968:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788838062.562093:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838062.562292:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037107968:12345-0@lo:400:kworker.0 Request processed in 387us (3872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.562300:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788838062.562340:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.562376:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037108096:0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.562409:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.562427:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838062.562433:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037108224:0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.562454:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.562478:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037107712 00000100:00100000:3.0:1788838062.562482:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037107712 00000100:00100000:3.0:1788838062.562514:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037108096 00000100:00100000:3.0:1788838062.562517:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037108096 00000100:00100000:3.0:1788838062.562536:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037108224 00000100:00100000:3.0:1788838062.562539:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037108224 00000100:00100000:3.0:1788838062.562552:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788838062.562558:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037107712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.562595:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037107712:12345-0@lo:400:kworker.0 Request processed in 37us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.562600:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788838062.562613:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788838062.562619:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037108096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.562641:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037108096:12345-0@lo:400:kworker.0 Request processed in 23us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.562646:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788838062.562655:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788838062.562659:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732037108224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.562679:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732037108224:12345-0@lo:400:kworker.0 Request processed in 20us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.562684:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788838062.562697:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838062.562700:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788838062.562717:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3d9d880 x1875732037108224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838062.562728:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037108224:0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.562736:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037108096:0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.562746:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037107712:0@lo:400:kworker.0 00010000:00080000:1.0:1788838062.563201:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3d9f800 x1875732037107968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838062.563213:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037107968:0@lo:400:kworker.0 00000100:00100000:0.0:1788838062.564224:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.564549:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037107584 00000100:00100000:3.0:1788838062.564556:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037107584 00000100:00100000:3.0:1788838062.564615:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788838062.564624:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037107584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838062.564719:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037107584:12345-0@lo:400:kworker.0 Request processed in 96us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.564726:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788838062.564830:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcaeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037107584:0@lo:400:kworker.0 10000000:01000000:2.0:1788838063.161455:0:22759:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788838063.161464:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ad01d4000 from 13 10000000:01000000:2.0:1788838063.161470:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838063.161526:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.161539:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.161551:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838063.161577:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838063.161653:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.161769:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838063.162589:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037108352 00000100:00100000:0.0:1788838063.162598:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037108352 00000100:00100000:0.0:1788838063.162714:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788838063.163713:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+20:22759:x1875732037108352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838063.163737:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838063.163760:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa791c00/0x57f6d4e926af0f1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0f15 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.163807:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa791c00/0x57f6d4e926af0f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0f15 expref: 21 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.163819:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa791c00/0x57f6d4e926af0f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0f15 expref: 21 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.163829:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791c00, rc 0) 00000100:00100000:0.0:1788838063.163934:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:22759:x1875732037108352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1211us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.163943:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788838063.164057:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838063.164074:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0f15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f1c expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.164083:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0f15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0f1c expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838063.164514:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838063.164554:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.165183:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838063.165683:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037108480 00000100:00100000:0.0:1788838063.165691:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037108480 00000100:00100000:0.0:1788838063.165731:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788838063.165741:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac9077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:22759:x1875732037108480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.165902:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac9077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:22759:x1875732037108480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.165933:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788838063.166099:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838063.166144:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838063.166197:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.166235:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838063.166527:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037108608 00000100:00100000:0.0:1788838063.166532:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037108608 00000100:00100000:0.0:1788838063.166552:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788838063.166558:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac2c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:22759:x1875732037108608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.166648:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac2c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:22759:x1875732037108608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.166654:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788838063.166752:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838063.168107:0:25801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788838063.168883:0:22759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788838063.168913:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838063.168938:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0f15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f1c expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.168952:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0f15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f1c expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838063.168963:0:22759:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788838063.168966:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac6b15000 from 13 10000000:01000000:0.0:1788838063.168969:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788838063.169009:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791a00/0x57f6d4e926af0f23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.169017:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa791a00/0x57f6d4e926af0f23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.169028:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa791a00/0x57f6d4e926af0f23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838063.169053:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.169133:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838063.169179:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788838063.169602:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037108736 00000100:00100000:2.0:1788838063.169610:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037108736 00000100:00100000:2.0:1788838063.169652:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788838063.169661:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+21:22759:x1875732037108736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838063.169674:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838063.169689:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c8a00/0x57f6d4e926af0f2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0f23 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.169716:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8a00/0x57f6d4e926af0f2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0f23 expref: 22 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.169727:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c8a00/0x57f6d4e926af0f2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0f23 expref: 22 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.169736:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8a00, rc 0) 00000100:00100000:2.0:1788838063.169797:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:22759:x1875732037108736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.169812:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788838063.170170:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838063.170187:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa791a00/0x57f6d4e926af0f23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f2a expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.170197:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa791a00/0x57f6d4e926af0f23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0f2a expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838063.171087:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.171138:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838063.171177:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838063.171275:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037108864 00000100:00100000:1.0:1788838063.171513:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037108864 00000100:00100000:1.0:1788838063.171555:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788838063.171564:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:22759:x1875732037108864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838063.171689:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:22759:x1875732037108864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838063.171696:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788838063.171876:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.171915:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.172272:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838063.172570:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838063.180504:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037108992 00000100:00100000:1.0:1788838063.180533:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037108992 00000100:00100000:1.0:1788838063.180609:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788838063.180620:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:22759:x1875732037108992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838063.180817:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:22759:x1875732037108992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (8544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838063.180824:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788838063.182173:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037108992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838063.188686:0:25802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788838063.196924:0:22759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788838063.196964:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788838063.196978:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791a00/0x57f6d4e926af0f23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f2a expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.196990:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa791a00/0x57f6d4e926af0f23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f2a expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838063.197003:0:22759:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788838063.197006:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8899c277b800 from 13 10000000:01000000:1.0:1788838063.197009:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788838063.197051:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0f31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.197059:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0f31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.197069:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0f31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838063.197125:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838063.197194:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838063.197254:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e636c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838063.197368:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037109120 00000100:00100000:0.0:1788838063.197385:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037109120 00000100:00100000:0.0:1788838063.197426:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788838063.197433:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+22:22759:x1875732037109120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838063.197445:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838063.197457:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa790c00/0x57f6d4e926af0f38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0f31 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.197489:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa790c00/0x57f6d4e926af0f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0f31 expref: 23 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.197500:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa790c00/0x57f6d4e926af0f38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0f31 expref: 23 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.197508:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790c00, rc 0) 00000100:00100000:0.0:1788838063.197560:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:22759:x1875732037109120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.197566:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788838063.197609:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838063.197622:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0f31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f38 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.197630:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0f31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0f38 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838063.197684:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.197708:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838063.197720:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838063.197966:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037109248 00000100:00100000:3.0:1788838063.197971:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037109248 00000100:00100000:3.0:1788838063.198001:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788838063.198008:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:22759:x1875732037109248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838063.198115:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:22759:x1875732037109248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.198122:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788838063.198408:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.198439:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.198481:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838063.198500:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838063.198699:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037109376 00000100:00100000:3.0:1788838063.198704:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037109376 00000100:00100000:3.0:1788838063.198739:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788838063.198746:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:22759:x1875732037109376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838063.198876:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:22759:x1875732037109376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.198883:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788838063.199038:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838063.200754:0:25803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788838063.201020:0:22759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788838063.201047:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838063.201058:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0f31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f38 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.201069:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a000/0x57f6d4e926af0f31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f38 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838063.201078:0:22759:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788838063.201081:0:22759:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8899c30c6000 from 13 10000000:01000000:0.0:1788838063.201083:0:22759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788838063.201128:0:22759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa790a00/0x57f6d4e926af0f3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.201136:0:22759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa790a00/0x57f6d4e926af0f3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.201145:0:22759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa790a00/0x57f6d4e926af0f3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838063.201166:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.201226:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838063.201278:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788838063.201716:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037109504 00000100:00100000:1.0:1788838063.201725:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037109504 00000100:00100000:1.0:1788838063.201841:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788838063.201861:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+23:22759:x1875732037109504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838063.201875:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838063.201891:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9a400/0x57f6d4e926af0f46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0f3f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.201916:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9a400/0x57f6d4e926af0f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0f3f expref: 24 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.201936:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9a400/0x57f6d4e926af0f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0f3f expref: 24 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.201944:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a400, rc 0) 00000100:00100000:1.0:1788838063.201987:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:22759:x1875732037109504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838063.201993:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788838063.202066:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838063.202080:0:22759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa790a00/0x57f6d4e926af0f3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f46 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.202099:0:22759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa790a00/0x57f6d4e926af0f3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0f46 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838063.202176:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.202204:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838063.208178:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838063.212186:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037109632 00000100:00100000:3.0:1788838063.212203:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037109632 00000100:00100000:3.0:1788838063.212291:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788838063.212302:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:22759:x1875732037109632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838063.212741:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:22759:x1875732037109632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 439us (10535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.212764:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788838063.212937:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.212987:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.213035:0:22759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838063.213058:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838063.213251:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037109760 00000100:00100000:3.0:1788838063.213256:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037109760 00000100:00100000:3.0:1788838063.213288:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788838063.213295:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:22759:x1875732037109760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838063.213588:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa513c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:22759:x1875732037109760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 293us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.213596:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788838063.213682:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:22759:1875732037109760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838063.219402:0:25804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788838063.219749:0:22759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788838063.219772:0:22759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788838063.219809:0:22759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa790a00/0x57f6d4e926af0f3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f46 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.219821:0:22759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa790a00/0x57f6d4e926af0f3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0f46 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.227134:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838063.276831:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838063.277081:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012882688 00000100:00100000:3.0:1788838063.277105:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012882688 00000100:00100000:3.0:1788838063.277190:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:3.0:1788838063.277202:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:18675:x1875732012882688:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788838063.277224:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788838063.277355:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788838063.277504:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0f4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0a3 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277574:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277606:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277617:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277632:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277639:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277645:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277721:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228800/0x57f6d4e926af0f62 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277729:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228800/0x57f6d4e926af0f62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277735:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228800/0x57f6d4e926af0f62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838063.277761:0:22764:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838063.277764:0:22764:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838063.277823:0:22764:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228800/0x57f6d4e926af0f62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277833:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277865:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277871:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277877:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788838063.277881:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277889:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277900:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:3.0:1788838063.277903:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838063.277908:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.277914:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.278043:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.278049:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.278055:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.278060:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788838063.278070:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.278077:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.278085:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff889aca2e8400) 00010000:00010000:3.0:1788838063.278160:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838063.278164:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.278171:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.278207:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0f4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0a3 expref: 8 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.278222:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228800/0x57f6d4e926af0f62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0a3 expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.278293:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff889aca2e8b00) 00010000:00010000:3.0:1788838063.278297:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838063.278299:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2228800, rc 0) 00000100:00100000:3.0:1788838063.278417:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:18675:x1875732012882688:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1217us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.278425:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:0.0:1788838063.302609:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838063.302726:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012882816 00000100:00100000:1.0:1788838063.302737:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012882816 00000100:00100000:1.0:1788838063.302815:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:1.0:1788838063.302836:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:18675:x1875732012882816:12345-192.168.201.3@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788838063.302932:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:18675:x1875732012882816:12345-192.168.201.3@tcp:900:lhsmtool_posix.0 Request processed in 97us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838063.302940:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:1.0:1788838063.310725:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838063.310819:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012883072 00000100:00100000:3.0:1788838063.310831:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012883072 00000100:00100000:3.0:1788838063.310902:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:3.0:1788838063.310913:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:18675:x1875732012883072:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788838063.310962:0:22762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838063.310985:0:22762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0f69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0aa expref: -99 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311069:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f70 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311084:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311108:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311124:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f77 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311132:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311139:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311372:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228e00/0x57f6d4e926af0f7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311504:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228e00/0x57f6d4e926af0f7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311513:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228e00/0x57f6d4e926af0f7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838063.311523:0:22762:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788838063.311674:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311683:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f70 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311690:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311696:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788838063.311701:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311708:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f70 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311720:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff889aca2e8b00) 00010000:00010000:3.0:1788838063.311723:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838063.311728:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311734:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0f70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311748:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311754:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f77 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311760:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311833:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788838063.311837:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311845:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f77 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311864:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff889aca2e8400) 00010000:00010000:3.0:1788838063.311866:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838063.311869:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f77 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.311874:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af0f77 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.329337:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0f69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0aa expref: 10 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.329367:0:22762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228e00/0x57f6d4e926af0f7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0aa expref: 9 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.329377:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aca2e8200) 00010000:00010000:2.0:1788838063.329380:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838063.329384:0:22762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c2228e00, rc 0) 00000100:00100000:2.0:1788838063.329458:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+9:18675:x1875732012883072:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 18546us (18743us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788838063.329467:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:0.0:1788838063.343551:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838063.343658:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012883200 00000100:00100000:3.0:1788838063.343669:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012883200 00000100:00100000:3.0:1788838063.343737:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:3.0:1788838063.343748:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+9:18675:x1875732012883200:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788838063.343934:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcaeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+9:18675:x1875732012883200:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 188us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.343941:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:0.0:1788838063.349556:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838063.349711:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012883328 00000100:00100000:3.0:1788838063.349722:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012883328 00000100:00100000:3.0:1788838063.349838:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:3.0:1788838063.349862:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:18675:x1875732012883328:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788838063.350022:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788838063.352197:0:22763:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2173us 00000100:00100000:3.0:1788838063.359547:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.359912:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012883456 00000100:00100000:2.0:1788838063.359933:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012883456 00000100:00100000:2.0:1788838063.359998:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:2.0:1788838063.360007:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+9:18681:x1875732012883456:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788838063.360027:0:24119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838063.360049:0:24119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0b1 expref: -99 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360127:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0f93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360142:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360166:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360237:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0f9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360246:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360253:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360310:0:24119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360317:0:24119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0f93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360324:0:24119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360330:0:24119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788838063.360341:0:24119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360350:0:24119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0f93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360362:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:2.0:1788838063.360365:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838063.360377:0:24119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360390:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360412:0:24119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360419:0:24119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0f9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360425:0:24119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360436:0:24119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788838063.360440:0:24119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360446:0:24119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0f9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360455:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff889aded28200) 00010000:00010000:2.0:1788838063.360462:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838063.360465:0:24119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0f9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360471:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0f9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360507:0:24119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0f8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0b1 expref: 10 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360534:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:2.0:1788838063.360537:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838063.360541:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0b1 expref: 10 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.360550:0:24119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9a00, rc 0) 00000100:00100000:2.0:1788838063.360630:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+9:18681:x1875732012883456:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 619us (1087us total) trans 0 rc 301/301 00000100:00100000:2.0:1788838063.360638:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:1.0:1788838063.369497:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.369598:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012883584 00000100:00100000:2.0:1788838063.369608:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012883584 00000100:00100000:2.0:1788838063.369664:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:2.0:1788838063.369674:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+9:18681:x1875732012883584:12345-192.168.201.3@tcp:700:lfs.0 00000100:00100000:2.0:1788838063.369752:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+9:18681:x1875732012883584:12345-192.168.201.3@tcp:700:lfs.0 Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.369761:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:3.0:1788838063.375606:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.375695:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012883840 00000100:00100000:2.0:1788838063.375709:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012883840 00000100:00100000:2.0:1788838063.375761:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:2.0:1788838063.375772:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+9:18681:x1875732012883840:12345-192.168.201.3@tcp:36:lfs.0 00010000:00010000:2.0:1788838063.375857:0:22762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838063.375888:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0ec8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f02c expref: 9 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.375913:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:2.0:1788838063.377751:0:22762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838063.377833:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.377857:0:22762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f09c expref: 5 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.377867:0:22762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.377909:0:22762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f09c expref: 5 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.377994:0:22762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f09c expref: 5 pid: 24119 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838063.378009:0:22762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22762:1875732037109888:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788838063.378728:0:22762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838063.386076:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.386264:0:22762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22762:1875732037109888:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788838063.386294:0:22762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838063.386602:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:18675:x1875732012883328:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 36752us (37054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838063.386613:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:0.0:1788838063.386761:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012883968 00000100:00100000:0.0:1788838063.386769:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012883968 00010000:00010000:0.0:1788838063.387029:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f09c expref: 6 pid: 24119 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838063.387069:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:0.0:1788838063.387079:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:2396:x1875732012883968:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838063.387101:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838063.387110:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f09c expref: 6 pid: 24119 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.387123:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f09c expref: 6 pid: 24119 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.387159:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0f07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f09c expref: 6 pid: 24119 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.387173:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:0.0:1788838063.387179:0:22748:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.387188:0:22748:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.387197:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.387438:0:22762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.387446:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.387467:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.387478:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.387486:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.388073:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838063.388129:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2396:x1875732012883968:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 1048us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.388138:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00080000:1.0:1788838063.388449:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788838063.391358:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391377:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391385:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838063.391409:0:22762:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000262f58ae reply state 0000000037fda940 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391417:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391422:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff889aded28200) 00010000:00010000:2.0:1788838063.391424:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838063.391427:0:22762:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788838063.391432:0:22762:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788838063.391438:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391442:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391446:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391450:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788838063.391454:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391458:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391465:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:2.0:1788838063.391466:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838063.391469:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391478:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fa1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838063.391493:0:22762:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000262f58ae reply state 0000000037fda940 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391498:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.391501:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff889aca2e8400) 00010000:00010000:2.0:1788838063.391503:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838063.391504:0:22762:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788838063.391597:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+10:18681:x1875732012883840:12345-192.168.201.3@tcp:36:lfs.0 Request processed in 15825us (16004us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788838063.391606:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:3.0:1788838063.476118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.476260:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012884096 00000100:00100000:2.0:1788838063.476271:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012884096 00000100:00100000:2.0:1788838063.476332:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:2.0:1788838063.476342:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+10:18689:x1875732012884096:12345-192.168.201.3@tcp:101:lctl.0 00010000:00010000:2.0:1788838063.476369:0:24119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838063.476403:0:24119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0b8 expref: -99 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.476473:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0fbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.476487:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0fbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.476525:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0fbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838063.476570:0:24119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838063.476574:0:24119:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838063.476612:0:24119:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0fbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.476637:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0b8 expref: 12 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.476655:0:24119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926af0fbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0b8 expref: 11 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.476665:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:2.0:1788838063.476668:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838063.476671:0:24119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8200, rc 0) 00000100:00100000:2.0:1788838063.476739:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+11:18689:x1875732012884096:12345-192.168.201.3@tcp:101:lctl.0 Request processed in 398us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.476747:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:2.0:1788838063.503922:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838063.504448:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012884224 00000100:00100000:1.0:1788838063.504459:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012884224 00000100:00100000:1.0:1788838063.504570:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:1.0:1788838063.504582:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:18690:x1875732012884224:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788838063.504607:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838063.504635:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926af0fc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0bf expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.504709:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0fcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.504725:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0fcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.504738:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0fcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838063.504834:0:22763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788838063.504838:0:22763:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788838063.504869:0:22763:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0fcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.504895:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926af0fc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0bf expref: 7 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.504914:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0fcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0bf expref: 6 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.504923:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:1.0:1788838063.504926:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788838063.504929:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9aa00, rc 0) 00000100:00100000:1.0:1788838063.504997:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:18690:x1875732012884224:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 417us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838063.505005:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:0.0:1788838063.508958:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.509120:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012884352 00000100:00100000:2.0:1788838063.509131:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012884352 00000100:00100000:2.0:1788838063.509424:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:2.0:1788838063.509436:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:18690:x1875732012884352:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788838063.509457:0:24119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838063.509478:0:24119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0c6 expref: -99 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509561:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0fd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509576:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509588:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509600:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0fe0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509608:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509615:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509697:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af0fe7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509705:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af0fe7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509713:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af0fe7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838063.509750:0:24119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838063.509754:0:24119:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838063.509809:0:24119:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af0fe7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509834:0:24119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509840:0:24119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0fd9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509856:0:24119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0fd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509862:0:24119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788838063.509867:0:24119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0fd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509875:0:24119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0fd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509888:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:2.0:1788838063.509891:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838063.509896:0:24119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0fd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509901:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af0fd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509914:0:24119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509920:0:24119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0fe0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509925:0:24119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509936:0:24119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788838063.509939:0:24119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509946:0:24119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509954:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff889aca2e8400) 00010000:00010000:2.0:1788838063.509956:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838063.509959:0:24119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0fe0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509964:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0fe0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.509990:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0fd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0c6 expref: 8 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.510004:0:24119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af0fe7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0c6 expref: 7 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.510012:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff889aded28200) 00010000:00010000:2.0:1788838063.510014:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838063.510016:0:24119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9600, rc 0) 00000100:00100000:2.0:1788838063.510441:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+7:18690:x1875732012884352:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1006us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.510450:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:1.0:1788838063.513657:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838063.513754:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012884480 00000100:00100000:0.0:1788838063.513764:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012884480 00000100:00100000:0.0:1788838063.514003:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:0.0:1788838063.514014:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:18690:x1875732012884480:12345-192.168.201.3@tcp:900:lfs.0 00000100:00100000:0.0:1788838063.514119:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:18690:x1875732012884480:12345-192.168.201.3@tcp:900:lfs.0 Request processed in 106us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.514128:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:3.0:1788838063.518027:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838063.518485:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012884736 00000100:00100000:0.0:1788838063.518496:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012884736 00000100:00100000:0.0:1788838063.518583:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:0.0:1788838063.518594:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+7:18690:x1875732012884736:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788838063.518615:0:22762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838063.518637:0:22762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790e00/0x57f6d4e926af0fee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0cd expref: -99 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838063.518750:0:22762:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788838063.518908:0:22762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790e00/0x57f6d4e926af0fee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0cd expref: 9 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.518923:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:0.0:1788838063.518927:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838063.518931:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790e00/0x57f6d4e926af0fee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0cd expref: 9 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.518944:0:22762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790e00, rc 0) 00000100:00100000:0.0:1788838063.519011:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+8:18690:x1875732012884736:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 417us (994us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788838063.519018:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00080000:1.0:1788838063.520171:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838063.523269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838063.523579:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012884992 00000100:00100000:3.0:1788838063.523591:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012884992 00000100:00100000:3.0:1788838063.523654:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:3.0:1788838063.523665:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+8:18690:x1875732012884992:12345-192.168.201.3@tcp:36:lfs.0 00010000:00010000:3.0:1788838063.523725:0:22764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838063.523753:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af0fe7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0c6 expref: 8 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.523773:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff889aded28200) 00010000:00010000:3.0:1788838063.523823:0:22764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838063.523860:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.523874:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.523885:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838063.524703:0:22764:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023c01dfc reply state 000000007bbacca9 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.524720:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.524726:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff889aded28200) 00010000:00010000:3.0:1788838063.524729:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788838063.524733:0:22764:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788838063.524740:0:22764:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788838063.524860:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+9:18690:x1875732012884992:12345-192.168.201.3@tcp:36:lfs.0 Request processed in 1194us (1598us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788838063.524868:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:2.0:1788838063.527981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838063.528068:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012885248 00000100:00100000:3.0:1788838063.528079:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012885248 00000100:00100000:3.0:1788838063.528135:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:3.0:1788838063.528145:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+9:18690:x1875732012885248:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788838063.528398:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+10:18690:x1875732012885248:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 254us (428us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788838063.528406:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:2.0:1788838063.531994:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838063.532092:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012885504 00000100:00100000:0.0:1788838063.532103:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012885504 00000100:00100000:0.0:1788838063.532166:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:0.0:1788838063.532176:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+10:18690:x1875732012885504:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788838063.532213:0:22762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838063.532244:0:22762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926af1003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0d4 expref: -99 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532356:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af100a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532371:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af100a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532382:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af100a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532393:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af1011 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532400:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af1011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532405:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af1011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838063.532514:0:22762:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788838063.532585:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af100a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532593:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af100a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532600:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af100a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532606:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788838063.532611:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af100a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532629:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af100a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532642:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:0.0:1788838063.532646:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838063.532651:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af100a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532657:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af100a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532673:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af1011 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532678:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af1011 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532683:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af1011 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532688:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788838063.532690:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af1011 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532696:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af1011 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532703:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff889aca2e8400) 00010000:00010000:0.0:1788838063.532705:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838063.532708:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af1011 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532724:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af1011 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532759:0:22762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926af1003 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0d4 expref: 12 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532771:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:0.0:1788838063.532773:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838063.532832:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926af1003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0d4 expref: 12 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.532853:0:22762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791000, rc 0) 00000100:00100000:0.0:1788838063.532917:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+11:18690:x1875732012885504:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 741us (934us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788838063.532924:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:0.0:1788838063.540710:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.540860:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012885632 00000100:00100000:2.0:1788838063.540870:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012885632 00000100:00100000:2.0:1788838063.540930:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:2.0:1788838063.540942:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+11:18690:x1875732012885632:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788838063.540972:0:24119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838063.540994:0:24119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af101f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0db expref: -99 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.541097:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.541112:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.541123:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838063.541146:0:24119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838063.541150:0:24119:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838063.541169:0:24119:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.541194:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af101f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0db expref: 13 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.541615:0:24119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0db expref: 12 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.541647:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff889aded28200) 00010000:00010000:2.0:1788838063.541651:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838063.541655:0:24119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9400, rc 0) 00000100:00100000:2.0:1788838063.541870:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+12:18690:x1875732012885632:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 929us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.541878:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:1.0:1788838063.547551:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838063.548187:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012885760 00000100:00100000:3.0:1788838063.548435:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012885760 00000100:00100000:3.0:1788838063.548502:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:3.0:1788838063.548606:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+12:18690:x1875732012885760:12345-192.168.201.3@tcp:37:lfs.0 00000100:00100000:2.0:1788838063.560679:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+12:18690:x1875732012885760:12345-192.168.201.3@tcp:37:lfs.0 Request processed in 12156us (13129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.560693:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:0.0:1788838063.564808:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.564907:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012886016 00000100:00100000:2.0:1788838063.564918:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012886016 00000100:00100000:2.0:1788838063.564979:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:2.0:1788838063.564990:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac121f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+12:18690:x1875732012886016:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788838063.565214:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac121f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+13:18690:x1875732012886016:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 226us (449us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788838063.565236:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:1.0:1788838063.613984:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838063.617538:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012886144 00000100:00100000:0.0:1788838063.617555:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012886144 00000100:00100000:0.0:1788838063.617642:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:0.0:1788838063.617663:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+11:18696:x1875732012886144:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788838063.617686:0:22762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838063.617710:0:22762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af102d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0e2 expref: -99 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618312:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af1034 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618347:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af1034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618358:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af1034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618385:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af103b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618394:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af103b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618401:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af103b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618483:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791e00/0x57f6d4e926af1042 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618492:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791e00/0x57f6d4e926af1042 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618500:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791e00/0x57f6d4e926af1042 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838063.618536:0:22762:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788838063.618539:0:22762:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788838063.618582:0:22762:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791e00/0x57f6d4e926af1042 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618595:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af1034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618612:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af1034 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618619:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af1034 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618625:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788838063.618630:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af1034 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618637:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af1034 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618650:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:0.0:1788838063.618653:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838063.618658:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af1034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618664:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af1034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618680:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af103b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618686:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af103b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618692:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af103b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618697:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788838063.618706:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af103b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618713:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af103b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618721:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff889aca2e8400) 00010000:00010000:0.0:1788838063.618723:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838063.618727:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af103b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618733:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af103b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618763:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926af102d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0e2 expref: 13 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618821:0:22762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791e00/0x57f6d4e926af1042 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0e2 expref: 12 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.618830:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff889aded28200) 00010000:00010000:0.0:1788838063.618832:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788838063.618835:0:22762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791e00, rc 0) 00000100:00100000:0.0:1788838063.618931:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+12:18696:x1875732012886144:12345-192.168.201.3@tcp:101:bash.0 Request processed in 1278us (4955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.618939:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:1.0:1788838063.621629:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838063.624485:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012886272 00000100:00100000:0.0:1788838063.624501:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012886272 00000100:00100000:0.0:1788838063.624593:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:0.0:1788838063.624604:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:18696:x1875732012886272:12345-192.168.201.3@tcp:900:bash.0 00000100:00100000:0.0:1788838063.625872:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:18696:x1875732012886272:12345-192.168.201.3@tcp:900:bash.0 Request processed in 1258us (4243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.625887:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788838063.634356:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.634442:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012886528 00000100:00100000:2.0:1788838063.634452:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012886528 00000100:00100000:2.0:1788838063.634510:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:2.0:1788838063.634519:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+12:18696:x1875732012886528:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788838063.634544:0:24119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838063.634571:0:24119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af1049 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0e9 expref: -99 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.634700:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.634734:0:24119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0db expref: 12 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.634744:0:24119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.634821:0:24119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0db expref: 12 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.634836:0:24119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0db expref: 12 pid: 24119 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838063.634862:0:24119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24119:1875732037110016:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788838063.634951:0:24119:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838063.642971:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.643161:0:24119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24119:1875732037110016:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788838063.643194:0:24119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838063.643201:0:25789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012886656 00000100:00100000:3.0:1788838063.643209:0:25789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012886656 00010000:00010000:3.0:1788838063.643264:0:25789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0db expref: 13 pid: 24119 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838063.643312:0:25789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788838063.643321:0:25789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+13:2395:x1875732012886656:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788838063.643335:0:25789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838063.643342:0:25789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0db expref: 13 pid: 24119 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.643354:0:25789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0db expref: 13 pid: 24119 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.643377:0:25789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af1026 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0db expref: 13 pid: 24119 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.643393:0:25789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff889aded28200) 00010000:00010000:3.0:1788838063.643398:0:25789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.643408:0:25789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.643417:0:25789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.643451:0:25789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838063.643472:0:24119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.643479:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838063.643508:0:25789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+12:2395:x1875732012886656:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 188us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.643516:0:25789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00010000:00010000:2.0:1788838063.643670:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.643682:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.643698:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644390:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af105e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644402:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af105e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644409:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af105e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838063.644421:0:24119:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788838063.644447:0:24119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644454:0:24119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644461:0:24119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644466:0:24119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788838063.644470:0:24119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644477:0:24119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644487:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff889aded28200) 00010000:00010000:2.0:1788838063.644489:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838063.644501:0:24119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644508:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af1050 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838063.644517:0:24119:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000931b3f6 reply state 0000000066dd5c02 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644525:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644530:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff889aded28f00) 00010000:00010000:2.0:1788838063.644531:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838063.644533:0:24119:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788838063.644561:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af1049 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0e9 expref: 15 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644570:0:24119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af105e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0e9 expref: 14 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.644575:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:2.0:1788838063.644576:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788838063.644578:0:24119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8800, rc 0) 00000100:00100000:2.0:1788838063.644672:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+15:18696:x1875732012886528:12345-192.168.201.3@tcp:101:bash.0 Request processed in 10155us (10450us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788838063.644678:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:1.0:1788838063.666142:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838063.666331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838063.666444:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012886784 00000100:00100000:3.0:1788838063.666455:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012886784 00000100:00100000:3.0:1788838063.666528:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:3.0:1788838063.666540:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+15:18696:x1875732012886784:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788838063.666566:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838063.666589:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af106c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f0f0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.666681:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.666715:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.666728:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838063.666798:0:22763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788838063.666803:0:22763:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838063.666828:0:22763:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.666849:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.666878:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229a00/0x57f6d4e926af106c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0f0 expref: 17 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.666919:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0f0 expref: 16 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838063.666929:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:3.0:1788838063.666932:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838063.666936:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea6800, rc 0) 00000100:00100000:3.0:1788838063.667185:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+16:18696:x1875732012886784:12345-192.168.201.3@tcp:101:bash.0 Request processed in 646us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.667193:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:0.0:1788838063.667504:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012886912 00000100:00100000:0.0:1788838063.667512:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012886912 00000100:00100000:0.0:1788838063.667560:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 159 00000100:00100000:0.0:1788838063.667569:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+11:18056:x1875732012886912:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838063.667577:0:22757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838063.667589:0:22757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa790000/0x57f6d4e926af107a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003f0f7 expref: -99 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.667695:0:22757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa790000/0x57f6d4e926af107a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0f7 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.667713:0:22757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa790000/0x57f6d4e926af107a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0f7 expref: 12 pid: 22757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.667723:0:22757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790000, rc 0) 00000100:00100000:0.0:1788838063.667753:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+12:18056:x1875732012886912:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 186us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.667760:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 159 00000100:00100000:1.0:1788838063.670538:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838063.670609:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.670702:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012887296 00000100:00100000:2.0:1788838063.670712:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012887296 00000100:00100000:2.0:1788838063.670770:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:2.0:1788838063.670814:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+16:18696:x1875732012887296:12345-192.168.201.3@tcp:35:bash.0 00000001:00080000:2.0:1788838063.671085:0:22765:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:2.0:1788838063.671178:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+18:18696:x1875732012887296:12345-192.168.201.3@tcp:35:bash.0 Request processed in 366us (568us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1788838063.671186:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000020:00080000:2.0:1788838063.671191:0:22765:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788838063.671729:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012887040 00000100:00100000:3.0:1788838063.671736:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012887040 00000100:00100000:3.0:1788838063.672386:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 160 00000100:00100000:3.0:1788838063.672400:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+12:18056:x1875732012887040:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838063.672538:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+12:18056:x1875732012887040:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 141us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.672545:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 160 00000040:00080000:1.0:1788838063.678765:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788838063.683335:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838063.688129:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012887424 00000100:00100000:0.0:1788838063.688146:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012887424 00000100:00100000:0.0:1788838063.688297:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 161 00000100:00100000:0.0:1788838063.688309:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+12:18056:x1875732012887424:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838063.688530:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a6b125b-183c-4ab6-8c98-ae42522ec309+12:18056:x1875732012887424:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 222us (5204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.688547:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 161 00000100:00100000:1.0:1788838063.698452:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.698534:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012887552 00000100:00100000:2.0:1788838063.698547:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012887552 00000100:00100000:2.0:1788838063.698604:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 162 00000100:00100000:2.0:1788838063.698614:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+12:18056:x1875732012887552:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838063.698631:0:22756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838063.698649:0:22756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c9800/0x57f6d4e926af1081 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003f0fe expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.698678:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9800/0x57f6d4e926af1081 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0fe expref: 13 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.698690:0:22756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c9800/0x57f6d4e926af1081 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0fe expref: 13 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.698700:0:22756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9800, rc 0) 00000100:00100000:2.0:1788838063.698795:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18056:x1875732012887552:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 164us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.698803:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 162 00000100:00100000:1.0:1788838063.706875:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.710138:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012887680 00000100:00100000:2.0:1788838063.710157:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012887680 00000100:00100000:2.0:1788838063.710295:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 163 00000100:00100000:2.0:1788838063.710307:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18056:x1875732012887680:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838063.710508:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18056:x1875732012887680:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 202us (3646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.710517:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 163 00000100:00100000:1.0:1788838063.730171:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838063.730496:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012887808 00000100:00100000:3.0:1788838063.730508:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012887808 00000100:00100000:3.0:1788838063.730573:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 164 00000100:00100000:3.0:1788838063.730583:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18056:x1875732012887808:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838063.730749:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:18056:x1875732012887808:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 167us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.730757:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 164 00000100:00100000:1.0:1788838063.775483:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838063.775752:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012888064 00000100:00100000:0.0:1788838063.775765:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012888064 00000100:00100000:0.0:1788838063.775990:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:0.0:1788838063.775998:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+18:18708:x1875732012888064:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788838063.776021:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838063.776038:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af1088 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f105 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838063.776135:0:22764:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788838063.776230:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af1088 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f105 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.776246:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889aded28000) 00010000:00010000:0.0:1788838063.776248:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838063.776253:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af1088 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f105 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.776267:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791600, rc 0) 00000100:00100000:0.0:1788838063.776322:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+19:18708:x1875732012888064:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 324us (849us total) trans 12884901899 rc 301/301 00000100:00100000:0.0:1788838063.776329:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:1.0:1788838063.780671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.780922:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012888320 00000100:00100000:2.0:1788838063.780934:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012888320 00000100:00100000:2.0:1788838063.781000:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:2.0:1788838063.781010:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+19:18708:x1875732012888320:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788838063.781253:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+20:18708:x1875732012888320:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 244us (593us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788838063.781260:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:1.0:1788838063.832993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.833087:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012888576 00000100:00100000:2.0:1788838063.833098:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012888576 00000100:00100000:2.0:1788838063.833167:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:2.0:1788838063.833179:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+20:18711:x1875732012888576:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788838063.833205:0:22762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838063.833230:0:22762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9c00/0x57f6d4e926af1096 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f10c expref: -99 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.833353:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8400/0x57f6d4e926af109d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.833367:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8400/0x57f6d4e926af109d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.833378:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8400/0x57f6d4e926af109d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838063.833389:0:22762:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788838063.833508:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9c00/0x57f6d4e926af1096 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f10c expref: 23 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.833527:0:22762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8400/0x57f6d4e926af109d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f10c expref: 22 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838063.833535:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:2.0:1788838063.833538:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838063.833541:0:22762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8400, rc 0) 00000100:00100000:2.0:1788838063.833607:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+22:18711:x1875732012888576:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 431us (624us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788838063.833616:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:2.0:1788838063.839412:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.839471:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838063.839593:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012888832 00000100:00100000:0.0:1788838063.839607:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012888832 00000100:00100000:0.0:1788838063.839691:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:0.0:1788838063.839703:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+22:18711:x1875732012888832:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:0.0:1788838063.839822:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10ab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.839851:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.839864:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.839908:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.839915:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10ab lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.839921:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.839927:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788838063.839933:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.839939:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10ab lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.839951:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:0.0:1788838063.839954:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838063.839958:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10ab lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838063.839965:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10ab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838063.840057:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+22:18711:x1875732012888832:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 357us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.840066:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:1.0:1788838063.840331:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012888704 00000100:00100000:1.0:1788838063.840336:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012888704 00000100:00100000:1.0:1788838063.840379:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:1.0:1788838063.840387:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+22:2393:x1875732012888704:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838063.840399:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838063.840418:0:22749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8400/0x57f6d4e926af109d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f10c expref: 22 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838063.840430:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:1.0:1788838063.840434:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838063.840454:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+21:2393:x1875732012888704:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 69us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838063.840461:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:1.0:1788838063.843279:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838063.845580:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012889088 00000100:00100000:2.0:1788838063.845595:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012889088 00000100:00100000:2.0:1788838063.845653:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788838063.845661:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+21:18711:x1875732012889088:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788838063.845908:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+22:18711:x1875732012889088:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 243us (2643us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788838063.845917:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788838064.223734:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838064.223872:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012889344 00000100:00100000:2.0:1788838064.223883:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012889344 00000100:00100000:2.0:1788838064.223952:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:2.0:1788838064.223963:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+22:18742:x1875732012889344:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:2.0:1788838064.224064:0:22762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838064.224089:0:22762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926af10b2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f113 expref: -99 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.224226:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9c00/0x57f6d4e926af10b9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.224242:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9c00/0x57f6d4e926af10b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.224255:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9c00/0x57f6d4e926af10b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838064.224266:0:22762:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788838064.224385:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926af10b2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f113 expref: 25 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.224404:0:22762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9c00/0x57f6d4e926af10b9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f113 expref: 24 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.224413:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:2.0:1788838064.224416:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838064.224420:0:22762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9c00, rc 0) 00000100:00100000:2.0:1788838064.224575:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+24:18742:x1875732012889344:12345-192.168.201.3@tcp:101:cat.0 Request processed in 613us (861us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788838064.224587:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:2.0:1788838064.230621:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838064.230930:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012889472 00000100:00100000:1.0:1788838064.230941:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012889472 00000100:00100000:1.0:1788838064.231086:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:1.0:1788838064.231098:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+24:2396:x1875732012889472:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838064.231131:0:22747:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838064.231159:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9c00/0x57f6d4e926af10b9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f113 expref: 24 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.231178:0:22747:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:1.0:1788838064.231183:0:22747:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838064.231892:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+23:2396:x1875732012889472:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 791us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838064.231902:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:1.0:1788838064.235765:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838064.236351:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012889728 00000100:00100000:0.0:1788838064.236361:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012889728 00000100:00100000:0.0:1788838064.236417:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:0.0:1788838064.236426:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+23:18742:x1875732012889728:12345-192.168.201.3@tcp:35:cat.0 00000100:00100000:0.0:1788838064.237439:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+24:18742:x1875732012889728:12345-192.168.201.3@tcp:35:cat.0 Request processed in 1008us (1679us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788838064.237458:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00010000:00010000:0.0:1788838064.249100:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788838064.251185:0:23520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788838064.310636:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838064.311105:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012889984 00000100:00100000:0.0:1788838064.311117:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012889984 00000100:00100000:0.0:1788838064.311185:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:0.0:1788838064.311195:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+24:18748:x1875732012889984:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:0.0:1788838064.311229:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838064.311250:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10c7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f11a expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.311367:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af10ce lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.311381:0:22764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af105e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0e9 expref: 25 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.311407:0:22764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f0f0 expref: 25 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.311416:0:22764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af10ce lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.311449:0:22764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0f0 expref: 25 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.311463:0:22764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0f0 expref: 25 pid: 22763 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838064.311476:0:22764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00d15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22764:1875732037110144:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788838064.311566:0:22764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af105e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0e9 expref: 25 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.311576:0:22764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af105e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0e9 expref: 25 pid: 24119 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838064.311585:0:22764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22764:1875732037110272:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788838064.311606:0:22764:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838064.315926:0:22764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00d15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22764:1875732037110144:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788838064.315943:0:22764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22764:1875732037110272:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788838064.315970:0:22764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af10ce lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838064.317716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838064.317763:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838064.317878:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012890112 00000100:00100000:0.0:1788838064.317888:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012890112 00010000:00010000:0.0:1788838064.317929:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0f0 expref: 26 pid: 22763 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838064.317968:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012890240 00000100:00100000:0.0:1788838064.317971:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012890240 00010000:00010000:0.0:1788838064.317983:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af105e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0e9 expref: 27 pid: 24119 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838064.318011:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:0.0:1788838064.318020:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+27:2395:x1875732012890112:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838064.318045:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838064.318052:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0f0 expref: 27 pid: 22763 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318065:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0f0 expref: 27 pid: 22763 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318087:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6800/0x57f6d4e926af1073 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0f0 expref: 27 pid: 22763 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318103:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:0.0:1788838064.318108:0:22748:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af10ce lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318117:0:22748:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af10ce lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318137:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838064.318183:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+26:2395:x1875732012890112:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 164us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838064.318191:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:0.0:1788838064.318209:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:0.0:1788838064.318216:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+25:2395:x1875732012890240:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838064.318224:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838064.318229:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af105e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0e9 expref: 25 pid: 24119 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318238:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af105e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0e9 expref: 25 pid: 24119 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318250:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af105e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f0e9 expref: 25 pid: 24119 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318259:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:0.0:1788838064.318263:0:22748:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af10ce lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318270:0:22748:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af10ce lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318278:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af10ce lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318302:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838064.318326:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+24:2395:x1875732012890240:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 110us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838064.318333:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00010000:00010000:0.0:1788838064.318387:0:22764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af10ce lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318395:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af10ce lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838064.318412:0:22764:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788838064.318561:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af10c7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f11a expref: 25 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318576:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790400/0x57f6d4e926af10ce lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f11a expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.318584:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:0.0:1788838064.318587:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788838064.318591:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790400, rc 0) 00000100:00100000:0.0:1788838064.318615:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+24:18748:x1875732012889984:12345-192.168.201.3@tcp:101:dd.0 Request processed in 7422us (7987us total) trans 12884901905 rc 0/0 00000100:00100000:0.0:1788838064.318623:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:2.0:1788838064.323046:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.323114:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012890368 00000100:00100000:3.0:1788838064.323134:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012890368 00000100:00100000:3.0:1788838064.323187:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:3.0:1788838064.323197:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+24:18748:x1875732012890368:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:3.0:1788838064.323230:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838064.323254:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7c00/0x57f6d4e926af10dc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f121 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.323297:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7e00/0x57f6d4e926af10e3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.323310:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7e00/0x57f6d4e926af10e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.323321:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7e00/0x57f6d4e926af10e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.323424:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7c00/0x57f6d4e926af10dc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f121 expref: 26 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.323440:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7e00/0x57f6d4e926af10e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f121 expref: 25 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.323449:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:3.0:1788838064.323452:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788838064.323455:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea7e00, rc 0) 00000100:00100000:3.0:1788838064.323515:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+25:18748:x1875732012890368:12345-192.168.201.3@tcp:101:dd.0 Request processed in 319us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838064.323523:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:1.0:1788838064.330929:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.331010:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012890624 00000100:00100000:3.0:1788838064.331044:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012890624 00000100:00100000:3.0:1788838064.331108:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:3.0:1788838064.331118:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+25:18748:x1875732012890624:12345-192.168.201.3@tcp:36:dd.0 00010000:00010000:3.0:1788838064.331350:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.331367:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.331379:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788838064.331422:0:24119:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:3.0:1788838064.331445:0:24119:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010a61223 reply state 000000002f8b61ee transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.331457:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.331464:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:3.0:1788838064.331467:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838064.331470:0:24119:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788838064.331561:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+28:18748:x1875732012890624:12345-192.168.201.3@tcp:36:dd.0 Request processed in 444us (642us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1788838064.331569:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00000020:00080000:3.0:1788838064.331574:0:24119:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788838064.338909:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.338994:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012890752 00000100:00100000:3.0:1788838064.339006:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012890752 00000100:00100000:3.0:1788838064.339079:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:3.0:1788838064.339089:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+28:18748:x1875732012890752:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:3.0:1788838064.339114:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838064.339149:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7c00/0x57f6d4e926af10f1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f128 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.339376:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7c00/0x57f6d4e926af10f1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f128 expref: 29 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.339394:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7c00/0x57f6d4e926af10f1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f128 expref: 29 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.339415:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:3.0:1788838064.339418:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788838064.339421:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea7c00, rc 0) 00000100:00100000:3.0:1788838064.339485:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+29:18748:x1875732012890752:12345-192.168.201.3@tcp:101:dd.0 Request processed in 395us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838064.339492:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:2.0:1788838064.351881:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838064.351983:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012891008 00000100:00100000:0.0:1788838064.351995:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012891008 00000100:00100000:0.0:1788838064.352067:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:0.0:1788838064.352077:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+29:18748:x1875732012891008:12345-192.168.201.3@tcp:103:dd.0 00010000:00010000:0.0:1788838064.352094:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838064.352119:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7c00/0x57f6d4e926af10f1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f128 expref: 29 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.352151:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:0.0:1788838064.352157:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838064.352217:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+28:18748:x1875732012891008:12345-192.168.201.3@tcp:103:dd.0 Request processed in 141us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838064.352225:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:1.0:1788838064.355495:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.355606:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012891136 00000100:00100000:3.0:1788838064.355616:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012891136 00000100:00100000:3.0:1788838064.355726:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:3.0:1788838064.355738:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+28:18748:x1875732012891136:12345-192.168.201.3@tcp:58:dd.0 00010000:00010000:2.0:1788838064.356407:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.356446:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.356458:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788838064.358424:0:24119:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788838064.358455:0:24119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788838064.358552:0:24119:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788838064.358642:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+28:18748:x1875732012891136:12345-192.168.201.3@tcp:58:dd.0 Request processed in 2901us (3153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838064.358652:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:1.0:1788838064.365679:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838064.365852:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012891264 00000100:00100000:2.0:1788838064.365864:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012891264 00000100:00100000:2.0:1788838064.365927:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:2.0:1788838064.365938:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+28:18748:x1875732012891264:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:2.0:1788838064.365962:0:22762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838064.365986:0:22762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af10ff lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f12f expref: -99 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.366135:0:22762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.366149:0:22762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af10ff lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f12f expref: 29 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.366169:0:22762:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.366202:0:22762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af10ff lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f12f expref: 29 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.366228:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:2.0:1788838064.366231:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838064.366236:0:22762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af10ff lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f12f expref: 29 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.366244:0:22762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9400, rc 0) 00000100:00100000:2.0:1788838064.366308:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+29:18748:x1875732012891264:12345-192.168.201.3@tcp:101:dd.0 Request processed in 372us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838064.366315:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 48 00000040:00080000:2.0:1788838064.697133:0:22797:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788838064.697146:0:22797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788838064.697175:0:22797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788838064.697186:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788838064.697367:0:22797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22797:1875732037110400:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788838064.697483:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fa840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838064.704381:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838064.705342:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012891392 00000100:00100000:0.0:1788838064.705354:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012891392 00000100:00100000:0.0:1788838064.705444:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:0.0:1788838064.705454:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+30:18749:x1875732012891392:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788838064.705487:0:22764:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788838064.705618:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+30:18749:x1875732012891392:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 165us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838064.705626:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:2.0:1788838064.706069:0:22797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22797:1875732037110400:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788838064.720389:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.720461:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012891520 00000100:00100000:3.0:1788838064.720470:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012891520 00000100:00100000:3.0:1788838064.720525:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:3.0:1788838064.720534:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+29:18749:x1875732012891520:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788838064.720606:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1106 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720622:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1106 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720650:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1106 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720716:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af110d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720724:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af110d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720731:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af110d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720753:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1114 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720761:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1114 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720767:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1114 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838064.720845:0:22763:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788838064.720849:0:22763:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838064.720861:0:22763:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1114 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720871:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1106 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720877:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1106 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720892:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1106 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720899:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788838064.720903:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1106 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720911:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1106 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.720928:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aca2e8200) 00010000:00010000:3.0:1788838064.721005:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838064.721010:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1106 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721016:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1106 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721154:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af110d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721162:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af110d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721168:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af110d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721172:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788838064.721175:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af110d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721191:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af110d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721199:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff889aca2e8f00) 00010000:00010000:3.0:1788838064.721201:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838064.721266:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af110d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721273:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af110d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721290:0:22763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1114 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721296:0:22763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1114 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721302:0:22763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1114 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721307:0:22763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788838064.721310:0:22763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1114 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721316:0:22763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1114 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721323:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:3.0:1788838064.721325:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838064.721328:0:22763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1114 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.721342:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1114 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838064.721423:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+29:18749:x1875732012891520:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 Request processed in 887us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838064.721431:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:1.0:1788838064.727646:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838064.727913:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012891776 00000100:00100000:0.0:1788838064.727927:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012891776 00000100:00100000:0.0:1788838064.728043:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:0.0:1788838064.728053:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+29:18749:x1875732012891776:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788838064.728077:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838064.728098:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af111b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f136 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728221:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1122 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728237:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1122 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728259:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1122 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838064.728271:0:22764:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788838064.728351:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1122 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728359:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1122 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728366:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1122 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728373:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788838064.728377:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1122 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728385:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1122 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728398:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:0.0:1788838064.728401:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788838064.728406:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1122 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728412:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1122 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728456:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af111b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f136 expref: 31 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728479:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aca2e8200) 00010000:00010000:0.0:1788838064.728482:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838064.728487:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af111b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f136 expref: 31 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.728496:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791600, rc 0) 00000100:00100000:0.0:1788838064.728573:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+30:18749:x1875732012891776:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 521us (936us total) trans 12884901908 rc 301/301 00000100:00100000:0.0:1788838064.728582:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:1.0:1788838064.744752:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838064.751129:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012891904 00000100:00100000:0.0:1788838064.751146:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012891904 00000100:00100000:2.0:1788838064.754722:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:2.0:1788838064.754743:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+30:18749:x1875732012891904:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788838064.754800:0:22763:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788838064.754963:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+30:18749:x1875732012891904:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 227us (10220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838064.754988:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:1.0:1788838064.762468:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838064.769729:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012892160 00000100:00100000:0.0:1788838064.769747:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012892160 00000100:00100000:0.0:1788838064.769860:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:0.0:1788838064.769871:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+30:18749:x1875732012892160:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788838064.769892:0:22762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838064.769913:0:22762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af1130 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f13d expref: -99 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838064.770540:0:22762:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =60 00000004:00080000:0.0:1788838064.770546:0:22762:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+60 in llog 00000004:00080000:0.0:1788838064.770561:0:22762:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:1.0:1788838064.777486:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af1137 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.777510:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af1137 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.777541:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af1137 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.777650:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791600/0x57f6d4e926af1130 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f13d expref: 33 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.777675:0:22762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af1137 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f13d expref: 32 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.777685:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1d200) 00010000:00010000:1.0:1788838064.777688:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838064.777691:0:22762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a600, rc 0) 00000100:00100000:1.0:1788838064.777838:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+32:18749:x1875732012892160:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 7906us (15317us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788838064.777849:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:1.0:1788838064.783178:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838064.783348:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012892416 00000100:00100000:0.0:1788838064.783358:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012892416 00000100:00100000:0.0:1788838064.783421:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:0.0:1788838064.783431:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+32:18749:x1875732012892416:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788838064.783529:0:22764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838064.783555:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af1137 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f13d expref: 32 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783576:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1d200) 00010000:00010000:0.0:1788838064.783587:0:22764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838064.783616:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1145 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783629:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1145 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783639:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1145 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783654:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af114c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x35f9a1ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783661:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af114c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35f9a1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783667:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af114c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35f9a1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783715:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1145 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783722:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1145 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783729:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1145 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783741:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788838064.783745:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1145 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783751:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1145 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783759:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff889aded28200) 00010000:00010000:0.0:1788838064.783762:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838064.783765:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1145 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783771:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926af1145 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783834:0:22764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af114c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35f9a1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783840:0:22764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af114c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35f9a1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783846:0:22764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af114c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35f9a1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783851:0:22764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788838064.783854:0:22764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af114c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35f9a1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783860:0:22764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af114c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x35f9a1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783878:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x35f9a1ac (ffff889af8da5800) 00010000:00010000:0.0:1788838064.783881:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838064.783883:0:22764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af114c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x35f9a1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.783889:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af114c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x35f9a1ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838064.784114:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+31:18749:x1875732012892416:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 683us (949us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788838064.784122:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:2.0:1788838064.787332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838064.787436:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012892544 00000100:00100000:1.0:1788838064.787446:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012892544 00000100:00100000:1.0:1788838064.787552:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:1.0:1788838064.787563:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+31:18749:x1875732012892544:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788838064.787584:0:22762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838064.787607:0:22762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1153 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f144 expref: -99 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.787643:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926af115a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.787671:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926af115a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.787683:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926af115a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.787843:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1153 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f144 expref: 33 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.787861:0:22762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926af115a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f144 expref: 32 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.787871:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1db00) 00010000:00010000:1.0:1788838064.787874:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788838064.787878:0:22762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9be00, rc 0) 00000100:00100000:1.0:1788838064.788021:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+32:18749:x1875732012892544:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 459us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838064.788029:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:1.0:1788838064.790632:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838064.790907:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012892800 00000100:00100000:0.0:1788838064.790918:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012892800 00000100:00100000:0.0:1788838064.791126:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:0.0:1788838064.791138:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+32:18749:x1875732012892800:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788838064.791223:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.791241:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.791252:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788838064.791424:0:22764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1788838064.791434:0:22764:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681662657012ns, next at 682662654265ns, rc = 0 00000004:00010000:0.0:1788838064.791484:0:22764:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cdc0db3 reply state 000000009704d308 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.791516:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.791523:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1db00) 00010000:00010000:0.0:1788838064.791526:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788838064.791530:0:22764:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838064.791670:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+34:18749:x1875732012892800:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 533us (1047us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1788838064.791677:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:2.0:1788838064.795903:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.796011:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012892928 00000100:00100000:3.0:1788838064.796021:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012892928 00000100:00100000:3.0:1788838064.796090:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:3.0:1788838064.796101:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+34:18749:x1875732012892928:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788838064.796127:0:24119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838064.796149:0:24119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1168 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f14b expref: -99 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.796209:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1168 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f14b expref: 35 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.796224:0:24119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1168 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f14b expref: 35 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.796242:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1db00) 00010000:00010000:3.0:1788838064.796245:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788838064.796249:0:24119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea7400, rc 0) 00000100:00100000:3.0:1788838064.796311:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+35:18749:x1875732012892928:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 212us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838064.796319:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:1.0:1788838064.799873:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838064.800155:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012893056 00000100:00100000:2.0:1788838064.800164:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012893056 00000100:00100000:2.0:1788838064.800267:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:2.0:1788838064.800278:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcb54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2396:x1875732012893056:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788838064.800574:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcb54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:2396:x1875732012893056:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 297us (709us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788838064.800583:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00080000:1.0:1788838064.800668:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838064.803405:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838064.803496:0:22765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012893312 00000100:00100000:1.0:1788838064.803505:0:22765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012893312 00000100:00100000:1.0:1788838064.803587:0:22765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:1.0:1788838064.803596:0:22765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+35:18749:x1875732012893312:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788838064.803832:0:22765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+36:18749:x1875732012893312:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 226us (424us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1788838064.803857:0:22765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:2.0:1788838064.805630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.805771:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012893568 00000100:00100000:3.0:1788838064.805813:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012893568 00000100:00100000:3.0:1788838064.805874:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:3.0:1788838064.805884:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+36:18749:x1875732012893568:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788838064.805991:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+36:18749:x1875732012893568:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 108us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838064.805999:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:2.0:1788838064.807946:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.808037:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012893696 00000100:00100000:3.0:1788838064.808046:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012893696 00000100:00100000:3.0:1788838064.808097:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:3.0:1788838064.808106:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+36:18749:x1875732012893696:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788838064.808123:0:24119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838064.808141:0:24119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af116f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f152 expref: -99 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.808212:0:24119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1176 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.808227:0:24119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1176 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.808237:0:24119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1176 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838064.808289:0:24119:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838064.808306:0:24119:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1176 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.808331:0:24119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6000/0x57f6d4e926af116f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f152 expref: 38 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.808363:0:24119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1176 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f152 expref: 37 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.808372:0:24119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1db00) 00010000:00010000:3.0:1788838064.808375:0:24119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788838064.808378:0:24119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea7200, rc 0) 00000100:00100000:3.0:1788838064.808424:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+37:18749:x1875732012893696:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 319us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838064.808430:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:3.0:1788838064.811143:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838064.811266:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012893824 00000100:00100000:2.0:1788838064.811275:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012893824 00000100:00100000:2.0:1788838064.811327:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:2.0:1788838064.811336:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+6:2396:x1875732012893824:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788838064.811351:0:24267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838064.811371:0:24267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af117d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f159 expref: -99 pid: 24267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838064.811397:0:24267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f80b1, blocks: 0x0 00010000:00010000:2.0:1788838064.811416:0:24267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788838064.811421:0:24267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838064.811429:0:24267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af117d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f159 expref: 7 pid: 24267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.811462:0:24267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af117d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f159 expref: 7 pid: 24267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.811474:0:24267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8600, rc 0) 00000100:00100000:2.0:1788838064.811529:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:2396:x1875732012893824:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 193us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838064.811536:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:2.0:1788838064.814644:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.814729:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012894080 00000100:00100000:3.0:1788838064.814739:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012894080 00000100:00100000:3.0:1788838064.814830:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:3.0:1788838064.814842:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+37:18749:x1875732012894080:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788838064.814953:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+37:18749:x1875732012894080:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 113us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838064.814961:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:0.0:1788838064.818515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.818644:0:24119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012894208 00000100:00100000:3.0:1788838064.818654:0:24119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012894208 00000100:00100000:3.0:1788838064.818715:0:24119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:3.0:1788838064.818725:0:24119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+37:18749:x1875732012894208:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788838064.820760:0:22742:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000004:00080000:0.0:1788838064.820829:0:22742:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788838064.820882:0:22742:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:3.0:1788838064.821132:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838064.821149:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037110528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788838064.821211:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838064.821275:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037110528 00000100:00100000:3.0:1788838064.821281:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037110528 00000100:00100000:3.0:1788838064.821327:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788838064.821335:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037110528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788838064.821444:0:24266:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788838064.821448:0:24266:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788838064.821450:0:24266:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788838064.821453:0:24266:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788838065 -> 1788838065 00002000:00010000:3.0:1788838064.821455:0:24266:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788838064.821492:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732037110528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (280us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788838064.821499:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1788838064.821549:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff889afa5fc700/2, rc 0, transno 12884901892 00000100:00100000:3.0:1788838064.821555:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037110528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788838064.821660:0:24119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+19:18749:x1875732012894208:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 Request processed in 2934us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838064.821669:0:24119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00010000:00010000:2.0:1788838064.822359:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822373:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822381:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822387:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2229400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788838064.822392:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822400:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822415:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff889aca2e8400) 00010000:00010000:2.0:1788838064.822418:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838064.822423:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822438:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2229400/0x57f6d4e926af0fa8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822461:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822466:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822472:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822477:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788838064.822480:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822485:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822494:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff889aded28200) 00010000:00010000:2.0:1788838064.822496:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838064.822499:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822505:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9e00/0x57f6d4e926af0faf lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822517:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822523:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822536:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822541:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788838064.822544:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822551:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822559:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff889aded28f00) 00010000:00010000:2.0:1788838064.822561:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838064.822564:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822570:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1057 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822583:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822589:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822595:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822600:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788838064.822603:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822619:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822626:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:2.0:1788838064.822629:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838064.822631:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822637:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6a00/0x57f6d4e926af10ea lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822646:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822653:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822659:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822664:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788838064.822666:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822672:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822678:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1db00) 00010000:00010000:2.0:1788838064.822680:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788838064.822683:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.822697:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af1161 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.822857:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.822865:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.822872:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.822876:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c2228a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788838064.822879:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.822884:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.822892:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff889aded28200) 00010000:00010000:1.0:1788838064.822894:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788838064.822897:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.822901:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c2228a00/0x57f6d4e926af0ffc lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788838064.822919:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838064.825558:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838064.825667:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012894336 00000100:00100000:2.0:1788838064.825677:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012894336 00000100:00100000:2.0:1788838064.825732:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:2.0:1788838064.825742:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:2395:x1875732012894336:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788838064.825898:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:2395:x1875732012894336:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 Request processed in 157us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838064.825905:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:3.0:1788838064.831363:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838064.831603:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012894592 00000100:00100000:2.0:1788838064.831614:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012894592 00000100:00100000:2.0:1788838064.831682:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:2.0:1788838064.831694:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+15:18749:x1875732012894592:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788838064.831828:0:22763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838064.831855:0:22763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7200/0x57f6d4e926af1176 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f152 expref: 15 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.831875:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1db00) 00010000:00010000:2.0:1788838064.831880:0:22763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838064.831924:0:22763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1184 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.832212:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1184 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.832223:0:22763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1184 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838064.832361:0:22763:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e441138 reply state 0000000093e51017 transno 12884901912 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1184 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.832373:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926af1184 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.832379:0:22763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1db00) 00010000:00010000:2.0:1788838064.832381:0:22763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838064.832384:0:22763:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838064.832528:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+16:18749:x1875732012894592:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 836us (1177us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1788838064.832536:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:0.0:1788838064.836703:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.836861:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012894720 00000100:00100000:3.0:1788838064.836872:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012894720 00000100:00100000:3.0:1788838064.837048:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:3.0:1788838064.837059:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c26ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:18749:x1875732012894720:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788838064.837080:0:25204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838064.837102:0:25204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f160 expref: -99 pid: 25204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.837140:0:25204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af117d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f159 expref: 8 pid: 24267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.837158:0:25204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838064.837162:0:25204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838064.837168:0:25204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 8 pid: 25204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.837214:0:25204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af117d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f159 expref: 8 pid: 24267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.837227:0:25204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af117d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f159 expref: 8 pid: 24267 timeout: 781 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838064.837241:0:25204:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25204:1875732037110656:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788838064.837327:0:25204:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52540 going to sleep for 11 seconds 00000100:00100000:3.0:1788838064.844568:0:25204:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25204:1875732037110656:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788838064.844610:0:25204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 8 pid: 25204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.844631:0:25204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea6000, rc 0) 00000100:00100000:3.0:1788838064.844740:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c26ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+8:18749:x1875732012894720:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 7682us (8046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838064.844750:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:2.0:1788838064.846089:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838064.846219:0:22747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012894848 00000100:00100000:1.0:1788838064.846228:0:22747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012894848 00010000:00010000:1.0:1788838064.846279:0:22747:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af117d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f159 expref: 8 pid: 24267 timeout: 781 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838064.846344:0:22747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:1.0:1788838064.846354:0:22747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+8:2396:x1875732012894848:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838064.846371:0:22747:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838064.846394:0:22747:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af117d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f159 expref: 8 pid: 24267 timeout: 781 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.846408:0:22747:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af117d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f159 expref: 8 pid: 24267 timeout: 781 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.846430:0:22747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd02cf4/0x57f6d4e926af117d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f159 expref: 8 pid: 24267 timeout: 781 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.846446:0:22747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838064.846451:0:22747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838064.846458:0:22747:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 7 pid: 25204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.846468:0:22747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 7 pid: 25204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.846503:0:22747:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 7 pid: 25204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838064.846531:0:22747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22747:1875732037110784:192.168.201.3@tcp:105: 00000100:00100000:1.0:1788838064.846602:0:22747:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838064.853788:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.854532:0:24886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012894976 00000100:00100000:3.0:1788838064.854544:0:24886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012894976 00000100:00100000:3.0:1788838064.854625:0:24886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:3.0:1788838064.854636:0:24886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+8:2396:x1875732012894976:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788838064.854818:0:24886:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788838064.854831:0:24886:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788838064 00002000:00010000:3.0:1788838064.854833:0:24886:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788838063 00002000:00010000:3.0:1788838064.854835:0:24886:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788838065 -> 1788838064 00002000:00010000:3.0:1788838064.854838:0:24886:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788838064.854902:0:24886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+9:2396:x1875732012894976:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 268us (1136us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788838064.854910:0:24886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:0.0:1788838064.855079:0:22747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22747:1875732037110784:192.168.201.3@tcp:105: 00010000:00010000:0.0:1788838064.855110:0:22747:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838064.855134:0:22747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+8:2396:x1875732012894848:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 8782us (9052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838064.855142:0:22747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:3.0:1788838064.857550:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838064.857984:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012895104 00000100:00100000:2.0:1788838064.857993:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012895104 00000100:00100000:2.0:1788838064.858062:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:2.0:1788838064.858072:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+8:2393:x1875732012895104:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788838064.858128:0:24268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.858150:0:24268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 8 pid: 25204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.858159:0:24268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838064.858163:0:24268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788838064.858168:0:24268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.858225:0:24268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 8 pid: 25204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.858241:0:24268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 8 pid: 25204 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838064.858265:0:24268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24268:1875732037110912:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788838064.858350:0:24268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3254a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838064.862630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788838064.862715:0:22748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012895232 00000100:00100000:0.0:1788838064.862724:0:22748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012895232 00010000:00010000:0.0:1788838064.862764:0:22748:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 9 pid: 25204 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838064.862847:0:22748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:0.0:1788838064.862858:0:22748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+9:2395:x1875732012895232:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838064.862892:0:22748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838064.862916:0:22748:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 9 pid: 25204 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.863003:0:22748:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 9 pid: 25204 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838064.863130:0:24268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24268:1875732037110912:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788838064.863240:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b06e1dc4/0x57f6d4e926af118b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003f160 expref: 9 pid: 25204 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.863391:0:24268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.863504:0:22748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788838064.863509:0:22748:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788838064.863515:0:22748:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.863525:0:22748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.863589:0:22748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838064.863646:0:22748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+8:2395:x1875732012895232:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 789us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838064.863654:0:22748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00010000:00010000:3.0:1788838064.865362:0:24268:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.865380:0:24268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.865406:0:24268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.865416:0:24268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.865444:0:24268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.865452:0:24268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788838064.865457:0:24268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.865467:0:24268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.865485:0:24268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.865492:0:24268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aabeeca/0x57f6d4e926af1192 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838064.865623:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:2393:x1875732012895104:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 Request processed in 7549us (8081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838064.865633:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:2.0:1788838064.868336:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838064.868710:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012895488 00000100:00100000:1.0:1788838064.868722:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012895488 00000100:00100000:1.0:1788838064.868861:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:1.0:1788838064.868872:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+16:18749:x1875732012895488:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788838064.868969:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.868987:0:22762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7e00/0x57f6d4e926af10e3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f121 expref: 16 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.868996:0:22762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.869044:0:22762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7e00/0x57f6d4e926af10e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f121 expref: 16 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.869058:0:22762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7e00/0x57f6d4e926af10e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f121 expref: 16 pid: 22763 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838064.869073:0:22762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22762:1875732037111040:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788838064.869155:0:22762:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e63840 going to sleep for 11 seconds 00000100:00100000:0.0:1788838064.871963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788838064.872039:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012895616 00000100:00100000:3.0:1788838064.872050:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012895616 00010000:00010000:3.0:1788838064.872091:0:22749:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7e00/0x57f6d4e926af10e3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f121 expref: 17 pid: 22763 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838064.872130:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:3.0:1788838064.872155:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c26ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+17:2396:x1875732012895616:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788838064.872169:0:22749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838064.872175:0:22749:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7e00/0x57f6d4e926af10e3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f121 expref: 17 pid: 22763 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.872188:0:22749:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7e00/0x57f6d4e926af10e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f121 expref: 17 pid: 22763 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.872218:0:22749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:3.0:1788838064.872225:0:22749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af10ff lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f12f expref: 17 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.872235:0:22749:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.872241:0:22749:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.872256:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838064.872275:0:22749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838064.872329:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c26ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+17:2396:x1875732012895616:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 175us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838064.872336:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00010000:00010000:1.0:1788838064.873098:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7e00/0x57f6d4e926af10e3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f121 expref: 16 pid: 22763 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838064.873129:0:22762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22762:1875732037111040:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788838064.873148:0:22762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.873156:0:22762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.873162:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.873501:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.873514:0:22762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1168 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f14b expref: 16 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.873522:0:22762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.873547:0:22762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1168 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f14b expref: 16 pid: 24119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.873560:0:22762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1168 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f14b expref: 16 pid: 24119 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838064.873573:0:22762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22762:1875732037111168:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788838064.873641:0:22762:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e63a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838064.877317:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838064.877418:0:25789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012895744 00000100:00100000:2.0:1788838064.877427:0:25789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012895744 00010000:00010000:2.0:1788838064.877471:0:25789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1168 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f14b expref: 17 pid: 24119 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838064.877507:0:25789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:2.0:1788838064.877516:0:25789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c26fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+17:2395:x1875732012895744:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788838064.877530:0:25789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838064.877536:0:25789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1168 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f14b expref: 17 pid: 24119 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.877548:0:25789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1168 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f14b expref: 17 pid: 24119 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.877569:0:25789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1db00) 00010000:00010000:2.0:1788838064.877586:0:25789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.877596:0:25789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.877603:0:25789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.877621:0:25789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838064.877671:0:25789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c26fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+17:2395:x1875732012895744:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 156us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838064.877677:0:25789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00010000:00010000:1.0:1788838064.877757:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7400/0x57f6d4e926af1168 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003f14b expref: 16 pid: 24119 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838064.877772:0:22762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22762:1875732037111168:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788838064.877834:0:22762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.877843:0:22762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.877850:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788838064.877957:0:22762:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1788838064.878066:0:22762:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:1.0:1788838064.878094:0:22762:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1788838064.878154:0:22762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22762:1875732037111296:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788838064.878194:0:22762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838064.878231:0:22762:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e63000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838064.878794:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037111296 00000100:00100000:2.0:1788838064.878800:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037111296 00000100:00100000:2.0:1788838064.878840:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788838064.878848:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22762:x1875732037111296:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788838064.878914:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22762:x1875732037111296:12345-0@lo:1000:mdt00_000.0 Request processed in 67us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838064.878921:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788838064.879766:0:22762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22762:1875732037111296:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788838064.880078:0:22762:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:1.0:1788838064.880138:0:22762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22762:1875732037111424:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788838064.880181:0:22762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838064.880301:0:22762:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e63240 going to sleep for 11 seconds 00000100:00100000:0.0:1788838064.880352:0:23503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037111424 00000100:00100000:0.0:1788838064.880357:0:23503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037111424 00000100:00100000:0.0:1788838064.880407:0:23503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788838064.880414:0:23503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22762:x1875732037111424:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838064.880531:0:23503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22762:x1875732037111424:12345-0@lo:1000:mdt00_000.0 Request processed in 117us (349us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788838064.880538:0:23503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788838064.880638:0:22762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb54a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22762:1875732037111424:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788838064.880672:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880682:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880695:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880702:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788838064.880707:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880714:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880729:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1db00) 00010000:00010000:1.0:1788838064.880732:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788838064.880736:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880742:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af11a0 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880770:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880863:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880869:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880874:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788838064.880876:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880892:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880901:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:1.0:1788838064.880904:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788838064.880910:0:22762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af10ff lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f12f expref: 19 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880921:0:22762:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af10ff lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f12f expref: 19 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.880999:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af10ff lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f12f expref: 19 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.881127:0:22762:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9400/0x57f6d4e926af10ff lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f12f expref: 19 pid: 22762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838064.881139:0:22762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22762:1875732037111552:192.168.201.3@tcp:105: 00000100:00100000:1.0:1788838064.881374:0:22762:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e63540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838064.887127:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838064.887237:0:22762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22762:1875732037111552:192.168.201.3@tcp:105: 00010000:00010000:1.0:1788838064.887269:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887278:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af10f8 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24119 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887306:0:22762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af11a7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887329:0:22762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af11a7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887338:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af11a7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887347:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af11a7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887351:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af11a7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887355:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af11a7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887359:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788838064.887361:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af11a7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887366:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af11a7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887373:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:1.0:1788838064.887375:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838064.887378:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af11a7 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887381:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926af11a7 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887387:0:22762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887394:0:22762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887398:0:22762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887400:0:22762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788838064.887402:0:22762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887405:0:22762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887409:0:22762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:1.0:1788838064.887410:0:22762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788838064.887412:0:22762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838064.887415:0:22762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b800/0x57f6d4e926af1199 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838064.887571:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+19:18749:x1875732012895488:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 18701us (19244us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1788838064.887578:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000020:00080000:1.0:1788838064.887583:0:22762:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788838064.887745:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012895872 00000100:00100000:2.0:1788838064.887752:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012895872 00000100:00100000:2.0:1788838064.887837:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:2.0:1788838064.887848:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac121c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+19:18748:x1875732012895872:12345-192.168.201.3@tcp:49:dd.0 00000100:00100000:2.0:1788838064.887939:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac121c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+19:18748:x1875732012895872:12345-192.168.201.3@tcp:49:dd.0 Request processed in 83us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838064.887943:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000040:00080000:3.0:1788838064.890894:0:22797:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788838064.890905:0:22797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788838064.891122:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838064.891163:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838064.891214:0:22766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012896256 00000100:00100000:2.0:1788838064.891222:0:22766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012896256 00000100:00100000:2.0:1788838064.891458:0:22766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:2.0:1788838064.891469:0:22766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+19:18749:x1875732012896256:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788838064.891729:0:22766:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788838064.891768:0:22766:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901918 00010000:00010000:2.0:1788838064.891842:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af11ae lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.891859:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af11ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.891870:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af11ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.891878:0:22766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af11ae lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.891885:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af11ae lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.891891:0:22766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af11ae lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.891910:0:22766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:3.0:1788838064.892020:0:22797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788838064.892090:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788838064.892637:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012896000 00000100:00100000:0.0:1788838064.892646:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012896000 00000100:00100000:0.0:1788838064.892695:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:0.0:1788838064.892704:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+22:18748:x1875732012896000:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:0.0:1788838064.892718:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838064.892733:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af11b5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003f167 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.892767:0:22764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926af11bc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.892814:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926af11bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.892834:0:22764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926af11bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.892952:0:22764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926af11b5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f167 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.892969:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926af11bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003f167 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838064.892989:0:22764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff889aded28300) 00010000:00010000:0.0:1788838064.892992:0:22764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788838064.892995:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790800, rc 0) 00000100:00100000:0.0:1788838064.893068:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+23:18748:x1875732012896000:12345-192.168.201.3@tcp:101:dd.0 Request processed in 364us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838064.893075:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:2.0:1788838064.893564:0:22766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+22:18749:x1875732012896256:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 2097us (2398us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1788838064.893573:0:22766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000020:00080000:2.0:1788838064.893577:0:22766:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788838064.893600:0:22750:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838064.893606:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af11ae lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.893621:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838064.893625:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af11ae lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.893633:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af11ae lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.893646:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff889b01a1db00) 00010000:00010000:2.0:1788838064.893648:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788838064.893653:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af11ae lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.893658:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926af11ae lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.893670:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838064.893672:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838064.893673:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838064.930256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838064.930428:0:24272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012896384 00000100:00100000:2.0:1788838064.930437:0:24272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012896384 00000100:00100000:2.0:1788838064.930514:0:24272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:2.0:1788838064.930523:0:24272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:2395:x1875732012896384:12345-192.168.201.3@tcp:4:dd.0 00002000:00010000:2.0:1788838064.930564:0:24272:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9f80b0, atime: 0x6a9f80af, ctime: 0x6a9f80b0, blocks: 0x0 00010000:00010000:2.0:1788838064.930571:0:24272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af11c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.930585:0:24272:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788838064.930588:0:24272:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838064.930606:0:24272:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af11c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.930617:0:24272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af11c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838064.935114:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788838064.936284:0:24274:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788838064.936299:0:24274:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788838064.937035:0:24274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012896512 00000100:00100000:1.0:1788838064.937046:0:24274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012896512 00000100:00100000:2.0:1788838064.937619:0:25806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:2.0:1788838064.937631:0:25806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+8:2395:x1875732012896512:12345-192.168.201.3@tcp:4:dd.0 00010000:00010000:2.0:1788838064.937671:0:25806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000818279d0/0x57f6d4e926af11ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.937701:0:25806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838064.937706:0:25806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838064.937713:0:25806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000818279d0/0x57f6d4e926af11ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838064.937727:0:25806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000818279d0/0x57f6d4e926af11ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788838065.003927:0:25084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:1.0:1788838065.003951:0:25084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1788838065.004172:0:24272:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1788838065.004178:0:24272:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1788838064 -> 1788838065 00002000:00010000:2.0:1788838065.004181:0:24272:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788838064 -> 1788838065 00002000:00010000:2.0:1788838065.004184:0:24272:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1788838065.004202:0:24272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af11c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.004216:0:24272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af11c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.004238:0:24272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af11c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.004256:0:24272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838065.004263:0:24272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af11c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.004273:0:24272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af11c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.004292:0:24272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af11c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.004300:0:24272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dcf1b1d/0x57f6d4e926af11c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838065.004399:0:24272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+7:2395:x1875732012896384:12345-192.168.201.3@tcp:4:dd.0 Request processed in 73871us (74153us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788838065.004410:0:24272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000001:00080000:1.0:1788838065.024484:0:25084:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1788838065.024940:0:25806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788838065.024945:0:25806:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788838065.024962:0:25806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000818279d0/0x57f6d4e926af11ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.024976:0:25806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000818279d0/0x57f6d4e926af11ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.025003:0:25806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000818279d0/0x57f6d4e926af11ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.025011:0:25806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788838065.025016:0:25806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000818279d0/0x57f6d4e926af11ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.025085:0:25806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000818279d0/0x57f6d4e926af11ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.025105:0:25806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000818279d0/0x57f6d4e926af11ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838065.025112:0:25806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000818279d0/0x57f6d4e926af11ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838065.025325:0:25806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2395:x1875732012896512:12345-192.168.201.3@tcp:4:dd.0 Request processed in 87690us (90212us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788838065.025335:0:25806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00010000:00010000:2.0:1788838065.273460:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788838065.913151:0:22797:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788838065.913162:0:22797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788838065.913183:0:22797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788838065.913190:0:22797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788838066.169453:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838066.169506:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838066.169530:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838066.169550:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838066.169577:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838066.169623:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838066.169642:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838066.169667:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838066.169693:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788838066.169735:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012897024 00000100:00100000:2.0:1788838066.169745:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012897024 00000100:00100000:2.0:1788838066.169836:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012897536 00000100:00100000:2.0:1788838066.169840:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012897536 00000100:00100000:2.0:1788838066.169856:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012897152 00000100:00100000:2.0:1788838066.169858:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012897152 00000100:00100000:2.0:1788838066.169869:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012897664 00000100:00100000:2.0:1788838066.169870:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012897664 00000100:00100000:2.0:1788838066.169886:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:2.0:1788838066.169894:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2396:x1875732012897024:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838066.169972:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2396:x1875732012897024:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 78us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838066.169979:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:2.0:1788838066.169995:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:2.0:1788838066.170001:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2396:x1875732012897536:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838066.170043:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2396:x1875732012897536:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 42us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838066.170050:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:2.0:1788838066.170063:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:2.0:1788838066.170069:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2396:x1875732012897152:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838066.170093:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2396:x1875732012897152:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838066.170099:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:2.0:1788838066.170117:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:2.0:1788838066.170123:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af1126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2396:x1875732012897664:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838066.170147:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af1126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2396:x1875732012897664:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838066.170152:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:2.0:1788838066.170293:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012896768 00000100:00100000:2.0:1788838066.170298:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012896768 00000100:00100000:2.0:1788838066.170321:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012897280 00000100:00100000:2.0:1788838066.170324:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012897280 00000100:00100000:2.0:1788838066.170335:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012896896 00000100:00100000:2.0:1788838066.170338:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012896896 00000100:00100000:2.0:1788838066.170348:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012897408 00000100:00100000:2.0:1788838066.170351:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012897408 00000100:00100000:2.0:1788838066.170363:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:2.0:1788838066.170370:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+22:2396:x1875732012896768:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838066.170401:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+22:2396:x1875732012896768:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 32us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838066.170408:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:2.0:1788838066.170420:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:2.0:1788838066.170426:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:2396:x1875732012897280:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838066.170451:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+6:2396:x1875732012897280:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838066.170457:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:2.0:1788838066.170468:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:2.0:1788838066.170474:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2396:x1875732012896896:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838066.170496:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c90cb75d-813d-4d4d-bbe3-08b26c6e8404+5:2396:x1875732012896896:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838066.170510:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:2.0:1788838066.170523:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:2.0:1788838066.170530:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2396:x1875732012897408:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838066.170556:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7952ad5d-ec79-42cc-a48b-4f2a9f1d049f+5:2396:x1875732012897408:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838066.170561:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:2.0:1788838066.170585:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012896640 00000100:00100000:2.0:1788838066.170589:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012896640 00000100:00100000:2.0:1788838066.170617:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 165 00000100:00100000:2.0:1788838066.170624:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aca1c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:2396:x1875732012896640:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788838066.170645:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aca1c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a6b125b-183c-4ab6-8c98-ae42522ec309+13:2396:x1875732012896640:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 22us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838066.170651:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 165 00000100:00080000:2.0:1788838066.170685:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838066.170689:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838066.170691:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838066.170693:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788838066.297279:0:22751:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788838066.688984:0:25844:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1788838067.129482:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838067.129518:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037111680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838067.129596:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838067.129719:0:22768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037111680 00000100:00100000:1.0:1788838067.129728:0:22768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037111680 00000100:00100000:1.0:1788838067.129814:0:22768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788838067.129825:0:22768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c26fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037111680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788838067.129861:0:22768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788838067.129913:0:22768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c26fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037111680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838067.129920:0:22768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788838067.129965:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037111680:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788838067.321480:0:22750:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838067.642215:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037111808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838067.642293:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838067.642370:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037111808 00000100:00100000:3.0:1788838067.642380:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037111808 00000100:00100000:3.0:1788838067.642432:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788838067.642440:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037111808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838067.642476:0:22767:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788838067.642526:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037111808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838067.642534:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788838067.642719:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037111808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838067.642823:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838067.642832:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037111936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838067.642858:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838067.642885:0:24270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037111936 00000100:00100000:3.0:1788838067.642889:0:24270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037111936 00000100:00100000:3.0:1788838067.642927:0:24270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788838067.642945:0:24270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037111936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838067.642965:0:24270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788838067.643001:0:24270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037111936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838067.643008:0:24270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788838067.643024:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838067.643051:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037111936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838067.645548:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037112448:0@lo:400:kworker.0 00000100:00100000:1.0:1788838067.645626:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838067.645661:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732037112960:0@lo:400:kworker.0 00000100:00100000:1.0:1788838067.645688:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838067.645711:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732037113472:0@lo:400:kworker.0 00000100:00100000:1.0:1788838067.645736:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838067.645757:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788838067.645763:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037112320:0@lo:400:kworker.0 00000100:00100000:1.0:1788838067.645815:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838067.645838:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037112832:0@lo:400:kworker.0 00000100:00100000:1.0:1788838067.645855:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838067.645869:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732037113344:0@lo:400:kworker.0 00000100:00100000:1.0:1788838067.645887:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838067.645921:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037112448 00000100:00100000:1.0:1788838067.645928:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037112448 00000100:00100000:1.0:1788838067.645997:0:25204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037112832 00000100:00100000:1.0:1788838067.646001:0:25204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037112832 00000100:00100000:1.0:1788838067.646030:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788838067.646041:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcaddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037112448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838067.646094:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcaddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037112448:12345-0@lo:400:kworker.0 Request processed in 54us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838067.646102:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788838067.646118:0:25204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788838067.646124:0:25204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcadca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037112832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838067.646146:0:25204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcadca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037112832:12345-0@lo:400:kworker.0 Request processed in 23us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838067.646152:0:25204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788838067.646167:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037112960 00000100:00100000:1.0:1788838067.646170:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037112960 00000100:00100000:1.0:1788838067.646191:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037113472 00000100:00100000:1.0:1788838067.646194:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037113472 00000100:00100000:3.0:1788838067.646470:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037113344 00000100:00100000:3.0:1788838067.646481:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037113344 00000100:00100000:3.0:1788838067.646502:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788838067.646508:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732037112960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838067.646544:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732037112960:12345-0@lo:400:kworker.0 Request processed in 37us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838067.646550:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788838067.646563:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788838067.646569:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732037113344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838067.646596:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732037113344:12345-0@lo:400:kworker.0 Request processed in 27us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838067.646602:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788838067.646650:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037112192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838067.646679:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838067.646698:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037112704:0@lo:400:kworker.0 00000100:00100000:3.0:1788838067.646717:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838067.646733:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcadf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732037113216:0@lo:400:kworker.0 00000100:00100000:3.0:1788838067.646753:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838067.646766:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788838067.646803:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037112064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838067.646825:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838067.646841:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037112576:0@lo:400:kworker.0 00000100:00100000:3.0:1788838067.646859:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838067.646877:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afcb54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037113088:0@lo:400:kworker.0 00000100:00100000:3.0:1788838067.646898:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838067.646919:0:24271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037112192 00000100:00100000:3.0:1788838067.646939:0:24271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037112192 00000100:00100000:3.0:1788838067.646963:0:24271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037112064 00000100:00100000:3.0:1788838067.646966:0:24271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037112064 00000100:00100000:3.0:1788838067.646978:0:24271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788838067.646983:0:24271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037112192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838067.646999:0:24271:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788838067.647035:0:24271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037112192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838067.647041:0:24271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788838067.647053:0:24271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788838067.647059:0:24271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037112064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838067.647079:0:24271:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788838067.647105:0:24271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037112064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838067.647110:0:24271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788838067.647135:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037112704 00000100:00100000:3.0:1788838067.647139:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037112704 00000100:00100000:3.0:1788838067.647154:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037113216 00000100:00100000:3.0:1788838067.647157:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037113216 00000100:00100000:0.0:1788838067.647280:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037112320 00000100:00100000:0.0:1788838067.647284:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037112320 00000100:00100000:0.0:1788838067.647314:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788838067.647320:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aca1c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:3651:x1875732037112320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.647354:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aca1c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1072646a-5be5-4430-bdc9-bbcfdd7c0a86+24:3651:x1875732037112320:12345-0@lo:400:kworker.0 Request processed in 35us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838067.647360:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788838067.647405:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037112576 00000100:00100000:0.0:1788838067.647410:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037112576 00000100:00100000:0.0:1788838067.647432:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788838067.647438:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037112576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.647467:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037112576:12345-0@lo:400:kworker.0 Request processed in 30us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838067.647483:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788838067.647500:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037113088 00000100:00100000:0.0:1788838067.647504:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037113088 00000100:00100000:0.0:1788838067.647521:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788838067.647527:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037112704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.647558:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037112704:12345-0@lo:400:kworker.0 Request processed in 31us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838067.647564:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788838067.647576:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788838067.647582:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037113088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.647607:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037113088:12345-0@lo:400:kworker.0 Request processed in 26us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838067.647613:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788838067.647626:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838067.647630:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838067.647632:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838067.647709:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1072646a-5be5-4430-bdc9-bbcfdd7c0a86:3651:1875732037112320:0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.647722:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037112832:0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.647732:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732037113344:0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.647741:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037112448:0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.647750:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732037112960:0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.647822:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c26fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037113600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838067.647848:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838067.647904:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037112064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838067.647913:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1788838067.647917:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff889afa5fc700, transno 12884901892 00000004:00080000:0.0:1788838067.647928:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1788838067.647943:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037112576:0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.647955:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037113088:0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.647966:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037112192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838067.647976:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037112704:0@lo:400:kworker.0 00000100:00100000:0.0:1788838067.648002:0:24271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037113600 00000100:00100000:0.0:1788838067.648005:0:24271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037113600 00000100:00100000:0.0:1788838067.648027:0:24271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788838067.648033:0:24271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c26fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037113600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838067.648043:0:24271:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788838067.648074:0:24271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c26fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037113600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838067.648081:0:24271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788838067.648109:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c26fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037113600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838067.648487:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788838067.649394:0:22758:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838067.651367:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788838067.651382:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732037113216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838067.651478:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732037113216:12345-0@lo:400:kworker.0 Request processed in 101us (4724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838067.651485:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788838067.651543:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afcadf800 x1875732037113216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838067.651558:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcadf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732037113216:0@lo:400:kworker.0 00000100:00100000:1.0:1788838067.661166:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afcadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732037113472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838067.661299:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afcadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732037113472:12345-0@lo:400:kworker.0 Request processed in 12804us (15561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838067.661310:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788838067.661461:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afcade300 x1875732037113472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838067.661478:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afcade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732037113472:0@lo:400:kworker.0 00000040:00080000:0.0:1788838068.346586:0:23520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788838068.348052:0:24294:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13850 lines, 13850 kept, 0 dropped, 0 bad.